WAYS YOU’LL CONTRIBUTE

We are seeking a highly skilled and motivated Big Data Engineer to join our data engineering organization. As a Big Data Engineer, DevX you will play a crucial role in creating the best developer experience for data and application engineers at Basis. You will design, implement and maintain deployment and ETL pipelines for data products. You will integrate with a multitude of products and APIs to ensure superior development, testing and release experience for developers. You will also contribute by

• Integration: Integrate diverse data sources and vendor products, including databases, APIs, and third-party services to make data available for analytical and operational use.
• Automation: Automate repetitive and complex ETL deployment tasks to improve team efficiency and reduce manual intervention.
• Data Pipeline Design: Develop, deploy, and maintain scalable data pipelines for large volumes of data.
• Monitoring and Troubleshooting: Implement monitoring solutions to track data pipeline performance and quickly identify and resolve issues.

WHAT YOU BRING TO THE TABLE

• Strong computer science fundamentals
• Strong programming skills in Python or Java
• Proficiency with SQL and relational databases
• Proficiency with Snowflake and their services (development, performance tuning)
• Proficiency with workflow orchestration engines (Apache Airflow, Argo Workflows)
• Proficiency with CI/CD engines (Harness, Circle CI, Argo CI/CD, Jenkins)
• Proficiency with build management tools (Bazel)
• Proficiency with at least one of database versioning tool (Flyway, Sqitch or similar)
• Proficiency with source control systems (Git)
• Experience with containerization and orchestration tools (Docker, Kubernetes)
• Experience developing for BI tools (Looker, Thoughtspot, Power BI)
• Ability to work independently and manage multiple tasks

OUR TECH STACK

• Python, Scala
• Hadoop, Spark, Hive
• Snowflake
• Kubernetes, Docker, Harness
• Kafka
• Airflow, Oozie
• AWS