Data Engineer at Clarity AI·

We decided to use python as our main language due to the fact that it is a mature language, easy to learn and develop and has powerful data ecosystem libraries such as pandas, dask and pyarrow. It is also used in airflow so it allows us to enrich our use of airflow with custom code to suit our needs. Finally, it is also the language that the Data Science team of our company use, so it lets us contribute to each other's libraries and have common libraries. Even though Python is our main language we do not rule out adding new ones in the future.

17 upvotes·17.8K views
Avatar of Jose Daniel  Escribano

Jose Daniel Escribano

Data Engineer at Clarity AI