Senior Software Data Engineer (Python)

Job Responsibilities

As a Senior Software Data Engineer (Python), you will be a driving force behind our data platform, ensuring the efficient ingestion, transformation, and delivery of large-scale web data for consumer insights. You will work closely with product and analytics teams to translate business requirements into robust, scalable solutions. Key duties include:
— Designing, implementing, and optimizing complex ETL pipelines using PySpark and Python to process billions of records daily while maintaining low latency and high throughput.
— Developing, testing, and maintaining production-grade data pipelines with a strong emphasis on data quality, validation frameworks, and automated monitoring.
— Building and maintaining scalable data solutions on Databricks within AWS, leveraging Spark clusters, S3 storage, Glue, and other cloud-native services.
— Writing, tuning, and reviewing complex SQL queries for data retrieval, aggregation, and reporting; collaborating with analysts to ensure performance and accuracy.
— Establishing data governance best practices, documenting pipeline architecture, and implementing version control and CI/CD workflows in a DevOps-driven environment.
— Collaborating in fluent English with distributed teams—data scientists, ML engineers, and frontend developers—to align on data contracts, schema evolution, and deployment schedules.

Why You Should Apply

Joining our growing B2B SaaS company means contributing to solutions that power consumer insights for global brands. Benefits of this position include:
— Fully remote work model with flexible scheduling, allowing you to tailor your day and maintain work-life balance.
— Exposure to cutting-edge technologies such as MLflow for model tracking, LLM experimentation, Big Data Lake architectures, and containerized CI/CD pipelines.
— Hands-on responsibility for end-to-end data workflows, from raw ingestion to feature engineering for advanced analytics and machine learning.
— Opportunity to influence technical roadmaps, propose optimizations, and lead initiatives that improve scalability and resiliency.
— Professional development through internal tech talks, external conference sponsorships, and mentorship from experienced data engineering leaders.

About Us

We are a leading SaaS provider specializing in large-scale web data analytics and consumer behavior insights for Fortune 500 companies. Our mission is to empower enterprises with actionable intelligence to drive strategic decisions and optimize customer experiences. We value innovation, transparency, and a learning mindset, fostering an inclusive culture that supports individual growth and cross-functional collaboration.

Our teams have processed over 10 petabytes of data to deliver real-time dashboards and advanced ML models that reveal emerging consumer trends. In this role, you will work directly with global clients, tailoring data solutions to their unique needs and deploying scalable pipelines in production. We emphasize code quality, thorough testing, reusable components, and continuous integration to uphold best practices across all data platform projects.

random_fact: According to Gartner, global data volumes double approximately every two years, highlighting the growing importance of expert data engineers in shaping competitive business strategies within the B2B SaaS market.