• Colorkrew Attendance at SXSW March 2023 in Texas with Colorkrew Biz

    If you read a lot about innovation and technology, you’ve probably heard or seen some publication involving the acronym SXSW. The acronym means South by Southwest and it is an innovation festival. We can say that it is one of the biggest events of our time involving people from all over the world who debate themes that involve innovation, media, music, behavior and interactivity.
    ...
  • A Brief Introduction to the Inner Working of MapReduce

    As a data engineer, you probably have heard about Hadoop. It is one of the most popular frameworks for distributed processing of large data sets. It is less costly and more secure than other frameworks. At its center is a programming model called MapReduce. Today we will take a closer look at MapReduce to understand the inner working of Hadoop.
    ...
  • ETL vs. ELT: Pick the Most Suitable Data Integration Method for Your Project

    As a data engineer, you probably have heard of the data integration methodology called ETL (Extract-Transform-Load). It has been around for a while, and many data engineers have used this methodology to build data pipelines. However, ETL is not the only option up our sleeves. Recently, ELT has also been gaining a lot of popularity.
    ...
  • Welcome to Colorkrew Biz Developer Camp

    Hi, I’m Alessandro. The Colorkrew Biz team recently went on a company camp at the Enoshima Beach House to make up for the disruptions caused by COVID-19. While the team had done well with remote work, the employer knew that in-person interactions and team bonding were important. We spent two days in a dreamy Beach House in the stunning Enoshima, partying and enjoying yourselves with our teammates.
    ...
  • All You Need to Know about Lazy Evaluation in Spark

    Few would disagree that the word “lazy” has a negative connotation. We usually describe someone who is not willing to work hard as lazy. However, not all laziness is undesirable, and sometimes we prefer laziness to diligence, especially in the computer science world. One example is lazy evaluation. Today, we will closely inspect why lazy evaluation is essential to Spark’s high performance and how lazy evaluation works in Spark.
    ...
  • Parquet Files: Smaller and Faster than CSV

    If you have been in the world of big data long enough, you probably have heard about Parquet files. You might even have used it while thinking to yourself: “why can’t we just use CSV files?” Today, I will debunk the mystery of Parquet files and explain why a growing number of data scientists prefer Parquet files to CSV files.
    ...
  • Actions, Narrow Transformations, and Wide Transformations

    Hi! My name is Ziyu Chen. I am a full-stack engineer at Colorkrew. I love learning and writing about data engineering. Today, I would like to discuss transformations and actions in Spark. Of course, you can dive into the world of Spark and perform ETL processes without knowing how they differ from each other.
    ...
  • Dependency Injection with Laravel

    Dependency Injection - With Laravel Dependency injection is a commonly used design pattern in object oriented programming. Through some pre-established conventions, we are able to manage the creation of our dependencies more easily. We can declare, replace, or even mock the dependencies as needed without the need to change the code that relies on the dependency.
    ...
  • The Power of TypeScript Types

    Any frontend developer knows the frustration of seeing the infamous “is not a function” message pop up. It reminds you that, even though your code might achieve your goal, you will not be able to assure its consistency or reliability. Without strict typing there is no stopping tiny slip-ups due to a lack of coffee - or sleep, depending on your dedication.
    ...
  • Technical onboarding in Colorkrew

    Hi all, This is Ning Li from Colorkrew. I am a lead engineer who oversees several in-house service developments in Colorkrew. In this blog, please let me introduce the technical onboarding in Colorkrew. We have been working hard to improve this progress in recent years, so that our new members can join the team smoothly and get excellent work experience.
    ...
  • What is Culture Deck, exactly? Three reasons why Dread Personnel decided to create Culture Deck

    Hello! I’m Yusuke, the HR guy with the dreadlocks. On December 1, 2021, we launch “Culture Deck.” ➡https://www.colorkrew.com/about/culture_deck/ In this blog, I’d want to explain why I came up with the concept of producing a Culture Deck in the first place. ■What exactly is a Culture Deck? A Culture Deck is a document that describes and summarizes a company’s corporate philosophy, management concepts, and anticipated employee conduct in a thorough manner.
    ...
  • Make your vision colorful! ~Vision Renewal

    On December 1, 2021, We updated our vision. 「 Color Your Work with Excitement 」 We wish to make working people’s daily life more exciting. We wish to provide color and variety to people’s lives. Our new vision was created with this in mind. The Vision Project Again This is the third renewal of our vision since I came to work at Colorkrew in 2010.
    ...
  • From European student to full-time software developer in Japan.

    Applying to Colorkrew from abroad About 2 years ago I started thinking about what I wanted to do after graduating. I had been living and studying in Groningen, which has a population of about 200.000 people, and I decided that my next city would be Tokyo. I had visited Japan a couple of times as a student to join a conference or do some sightseeing, but I had never lived there.
    ...
  • The Road to Super Flat Organization #10: Business Management in Super Flat Organization

    Dear readers of “The Road to Super Flat Organization.” Thank you so much for reading! Back number:The Road to Super Flat Organization #9: The Road to Non-territorial Office I found out that my friends did not press the “like” button, especially those who often tell me, “I read your blog!”
    ...