About The Role We are seeking an experienced Associate Staff Engineer Big Data with strong expertise in LookML, Looker Studio Pro, and Google Cloud Platform (GCP) to lead our data engineering, modeling, and visualization initiatives. This role demands a hands-on technologist with the ability to design, develop, and optimize large-scale data solutions, ensuring high availability, performance, and scalability. Data Pipeline Development & Optimization The candidate will work closely with cross-functional teams including analytics, product, and business stakeholders to build data pipelines, manage cloud infrastructure, and develop advanced data visualization and reporting Responsibilities :
- Design, develop, and maintain scalable and high-performance ETL/ELT pipelines using Apache Spark, Python, and related big data frameworks. - Ensure robustness, fault tolerance, and optimal resource utilization in distributed data processing.
Data Modeling And Visualization
- Build, maintain, and optimize LookML models, Explores, and dashboards within Looker Studio Pro to meet business intelligence and analytics needs. - Collaborate with analysts and business teams to translate requirements into actionable data models and visualizations.
Cloud Data Infrastructure Management
- Deploy, manage, and optimize GCP-based data workflows leveraging services such as BigQuery, Dataflow, Pub/Sub, and Cloud Storage. - Monitor, troubleshoot, and enhance data infrastructure for performance, scalability, and cost efficiency.
Database And Streaming Systems Management
- Work with multiple data storage technologies including PostgreSQL, MongoDB, Kafka, Hadoop, Hive, Pig, and Trino. - Ensure data quality, integrity, and security across diverse data systems.
Version Control, CI/CD, And Automation
- Implement CI/CD practices for data engineering workflows, leveraging Git and industry-standard deployment pipelines. - Automate data validation, testing, and deployment processes.
Agile Collaboration And Leadership
- Actively participate in Agile ceremonies including sprint planning, daily stand-ups, and retrospectives. - Mentor junior engineers and contribute to improving engineering best Skills and Technical Competencies : & Big Data Processing : - Apache Spark (Strong), Python (Expert)
Data Visualization & Modeling
- LookML, Looker Studio Pro (Advanced)
Cloud Platforms
- Google Cloud Platform (GCP) BigQuery, Dataflow, Pub/Sub, IAM
Databases & Query Languages
- PostgreSQL, MongoDB, Kafka, Hadoop, Hive, Pig, Trino - Proficiency in SQL-like languages (SQL, MQL, HQL)
DevOps & CI/CD
- Experience with Git version control and deployment pipelines
Agile Methodology
- Prior experience working in Agile/Scrum and Experience :
Education : Bachelors or Masters degree in Computer Science, Data Engineering, or a related field. Experience : 5 - 8 years of progressive experience in Big Data Engineering, with at least 2 years working on LookML/Looker and GCP projects. Certifications (Preferred) : Google Cloud Certified Professional Data Engineer, Looker certifications (ref:hirist.tech)