Data Engineer – MarineLabs


MarineLabs is currently hiring a Data Engineer to contribute to our cloud-based IoT technology stack MarineLabs is currently hiring a Data Engineer to contribute to our cloud-based IoT technology stack. The work involves the development and maintenance of code that runs on cloud infrastructure that ingests and processes data in real time from live field instruments. This role requires strong software engineering knowhow to build, maintain, and continuously improve fault-tolerant applications in a distributed cloud environment. The Data Pipeline Engineer is adept at writing clear, efficient, and robust data processing code, and reducing or eliminating work through automation and replication. Responsibilities Write code for the real-time data pipeline, batch processing, ETL, and analytics utilities, coordinating and collaborating with other developers, data scientists, and DevOps staffDevelop new elements of cloud infrastructure / microservices as needed for the data pipelineWrite unit tests and functional testsIdentify, design, and implement internal process improvementsTroubleshoot system failures and alerts, sometimes in real timeResearch and evaluate new software technologies and tools according to organization needsDocument code, designs, deployment, configuration, maintenance work and troubleshooting proceduresPossibly contribute to DevOps / data science given suitable experience / interest The ideal candidate will have: Strong Python programming skills and object-oriented designStrong Linux/UNIX command line tools and bash scripting skillsExperience in high performance computing, parallelization, batch processing, signal processingExperience with the HTTP request/response cycle, RESTful APIs / microservicesExperience with the software development life cycle, Agile methodology, and distributed revision control systems such as gitExperience with test-driven development and CI/CD toolsStrong work ethic, high attention to detail, dedication to quality, and excellent communication skillsStrong desire to learn, and ability to follow clear instructions, self-motivation, and is not afraid to ask questionsPassion for the ocean Knowledge/experience in the following areas would be an asset: Amazon Web Services (AWS) technologies such as: ECS/ECR, Lambda, S3, RDSSQL, noSQL, time series databasesContainerization technologies such as DockerWorking with environmental time series data / modeling / forecastingWorking with noisy data from sensors or imagersMarine environment and/or technologiesMachine learning / AI technologies Qualifications Undergraduate degree in Software Engineering, Computer Science or equivalent3+ years experience in a similar role in a professional setting The position is full time and offers flexibility in working locations (remote from home, but must be based in British Columbia), with occasional team meetings at the office / lab in Victoria. We offer a competitive compensation package including health benefits and robust vacation programs. We’d love to hear from candidates of all backgrounds, orientation and abilities. If this position sounds exciting to you, please send your resume and cover-letter that details what attracts you to this position and why you would be a good fit at MarineLabs to [email protected] Images Images Additional Info Job Type : Full-TimeLocation : Vancouver Island, BCExperience Level : Intermediate Level