Senior Staff Engineer - Data

As a Senior Staff Engineer at DeepIntent, you will play a crucial role in designing, building, and optimizing data pipelines to ensure high-quality data integration and real-time analytics. Your responsibilities will include mentoring and guiding a team of data engineers, collaborating with cross-functional teams, and driving best practices for data architecture and engineering.

- Lead and mentor a team of engineers, ensuring technical excellence and continuous improvement. - Provide guidance on complex technical issues, foster a culture of collaboration and innovation. - Design and develop robust, scalable, and efficient data pipelines for ETL processes. - Architect data solutions for seamless integration from diverse sources, on-premise and in the cloud. - Optimize data storage, retrieval, and processing for performance and scalability. - Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions. - Collaborate with the software engineering team to ensure smooth integration of data pipelines into applications. - Ensure data integrity, quality, and consistency across systems. - Implement and enforce data governance policies and best practices, ensuring compliance with data privacy regulations. - Stay updated with the latest trends in data engineering, big data technologies, and cloud platforms. - Drive automation, testing, and optimization within data pipelines to improve overall efficiency. - Lead the selection and implementation of appropriate technologies for data storage, processing, and retrieval. - Experience working with public clouds like GCP/AWS. - Proficient with SQL, Java, Spring boot, Python, or at least one Object-oriented language, Bash. - Experience with Apache open source projects such as Spark, Druid, Beam, Airflow, etc. and big data databases like BigQuery, Clickhouse, etc.

- Bachelors or Masters degree in Computer Science, Engineering, Data Science, or a related field (or equivalent work experience). - 8+ years of experience in data engineering or related roles, with at least 2 years in a leadership or senior technical position. - Extensive experience with data warehousing, ETL pipelines, data modeling, and data architecture. - Strong experience working with large-scale data processing frameworks (e.g., Hadoop, Apache Spark, Kafka). - Proficient in SQL, Python, Java, or other relevant programming languages. - Hands-on experience with cloud-based platforms (AWS, GCP, Azure). - Familiarity with data orchestration tools like Apache Airflow or similar. - Strong knowledge of databases (SQL and NoSQL) and data storage technologies. - Excellent problem-solving and analytical skills. - Strong communication and interpersonal skills, with the ability to work effectively with both technical and non-technical teams. DeepIntent is a leading player in the healthcare advertising industry, dedicated to improving patient outcomes through the strategic use of advertising, data science, and real-world clinical data. They offer a competitive benefits package designed to support employees both professionally and personally, including competitive salaries, comprehensive medical, dental, and vision insurance, 401K match program, unlimited PTO, remote-friendly culture, career development support, and more. DeepIntent values diversity and inclusivity, providing equal employment opportunities to all individuals, regardless of background or perspective.

As a Senior Staff Engineer at DeepIntent, you will play a crucial role in designing, building, and optimizing data pipelines to ensure high-quality data integration and real-time analytics. Your responsibilities will include mentoring and guiding a team of data engineers, collaborating with cross-functional teams, and driving best practices for data architecture and engineering.

- Lead and mentor a team of engineers, ensuring technical excellence and continuous improvement. - Provide guidance on complex technical issues, foster a culture of collaboration and innovation. - Design and develop robust, scalable, and efficient data pipelines for ETL processes. - Architect data solutions for seamless integration from diverse sources, on-premise and in the cloud. - Optimize data storage, retrieval, and processing for performance and scalability. - Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions. - Collaborate with the software engineering team to ensure smooth integration of data pipelines into applications. - Ensure data integrity, quality, and consistency across systems. - Implement and enforce data governance policies and best practices, ensuring compliance with data privacy regulations. - Stay updated with the latest trends in data engineering, big data technologies, and cloud platforms. - Drive automation, testing, and opti