Turing
A U.S.-based company that is developing a financial service platform that provides real estate investors and borrowers with rental and bridge loans, is looking for a Senior Databricks Engineer. The engineer will be responsible for guiding team members through best practices and cutting-edge data engineering technology. The company equips real estate agents with cutting-edge technologies and immediate funding to fund opportunities. The company has managed to secure more than $155mn in funding so far.
Job Responsibilities:
- Break down complex projects into actionable steps
- Oversee the development and implementation of Databricks and Snowflake-based data migration solutions in an AWS environment
- Develop and maintain real-time data pipelines, data lakes, and data warehouses in collaboration with cross-functional teams to understand data requirements and translate them into technological solutions
- Assure that compliance, security, and data quality criteria are met
- Design and implement data pipelines that turn raw data into actionable insights
Job Requirements:
- Bachelor??s/Master??s degree in Engineering, Computer Science (or equivalent experience)
- At least 5+ years of relevant experience as a data engineer
- 5+ years of experience with Databricks, Python, and AWS
- Extensive experience in Stream Processing, DLT (data live tables)
- Nice to have extensive experience working with PySpark and Snowflake
- Strong understanding of data modeling, delta lake, data warehousing, and ETL concepts
- Demonstrable experience with Stream Processing specifically with Spark Structured Streaming, DLT, etc
- Prior experience working with data governance and security best practices
- Must have some certifications such as Databricks Lakehouse Data Engineer, Associate, and AWS Certified Developer Associate
- Some experience with data migration in a regulated industry such as healthcare or finance is nice to have
- Familiarity with containerization and orchestration technologies such as Kubernetes and Docker is desirable
- Nice to have some experience with data visualization tools such as Tableau or Looker
- Experience with agile development methodologies is preferred
- Strong communication and leadership skills to effectively collaborate with cross-functional teams
- Fluent in spoken and written English