Senior Scala Engineer, Data Platform

  • London
  • Trainline
Job Description Senior Data Engineer London Hybrid 40 in office £Salary BenefitsIntroducing Data Engineering at TrainlineData Engineering is essential to how we unlock the value of data at Trainline Our mission is to liberate Trainline data and delight customers with great data products built on a frictionless modern data platform Our data products include machine learning models that add real value to the customer journey streaming data applications that personalize the customer experience in real time dashboards that drive deep business and customer insight and intuitive and efficient data marts and metrics built on our modern data lakehouseAs a Senior Data Engineer Scala you will be part of a crossfunctional data product team working alongside data scientists machine learning engineers and BI engineers Our data product teams are deeply embedded in the business so your work will have high impact by either drive key business decisions provide deep customer insights or by adding intelligent machine learning experiences right in the core of our customer journeysWe use an agile delivery playbook that encourages incremental and iterative delivery aims to release value early and often measure the impact of work and using hypotheses to ensure we are solving real customer problems Our data platform is a modern cloudnative lake house using bestofbreed technologies and partners all based on the AWS public cloudWe empower our Data teams and give engineers high levels of autonomy and freedom to innovate We encourage continuous learning with clear career progression plans innovationhack days and training opportunities such as DataCampAs a Senior Scala Data Engineer at Trainline you willUse cuttingedge Data technology to deliver worldclass data products using a combination of streaming technologies machine learning and automated data pipelinesWork in selforganised crossfunctional data teams alongside machine learning engineers BI engineers and product managersDrive continuous improvement to the software engineering and agile working practices of the teamContribute to the Technical Architecture direction of the teamQualificationsWed love to hear from you if youThrive in a diverse open and collaborative environment where impact is as valuable as technical skillHave excellent knowledge of Scala and the JVM ecosystemPossess strong understanding of functional programming paradigms and a willingness to adopt other languages not only JVM languagesHave consistent background in software development in high volume environmentsHave a pragmatic and openminded approach to achieving outcomes in the simplest way possibleHave worked with stream processing technologies Kafka Storm AWS Kinesis etcHave experience with AWS services especially EMR ECS EKSHave an obsession with software quality Dev Ops and automationWork well in lean agile crossfunctional product teams using Scrum and Kanban practicesAre a good communicator and comfortable with presenting ideas and outputs to technical and nontechnical stakeholdersOur technology stack PythonScala and the JVMKafka Kafka Streams and KSQLAWS S3 Parquet Iceberg Glue and EMR for our Data LakeTerraform and DockerElasticsearch and DynamodbSpark and AirflowTrinio Starburst and Presto AthenaML Flow and popular Python machine learning and analysis librariesThe interview processRecruiter Call 30 minsMeet the manager 30minsTechnical discussion with x2 Engineers 60 minsMeeting a crossfunctional team member30mins