Senior Data Engineer
Onward Search

Job Info

---

Our client, a video game company, is seeking a Senior Data Engineer to join the team.

Responsibilities:


Create and promote a technical design and architectural vision for security operations data systems and tooling
Work with engineers on the team to manage infrastructure for moving and processing large-scale data
Improve log flows efficiency through data processing to reduce the cost of analysis and storage
Convert log flows from Logstash to Elastic Common Schema
Work with Analysts to determine and implement the best practices for data retention and storage
Design and promote standards for security operations data telemetry and processing
Help engineers across the team select data technologies for their development needs
Be the face of data best-practices to engineers on the team around the product by advocating for data considerations early in the product life cycle and educating teammates on how to get the most out of company data ecosystem


Musts:


2+ years experience working with data systems
2+ years experience with data warehousing, processing, pipelines, infrastructure, and query patterns
2+ years experience with Spark or Hadoop
2+ years experience with open source ETL frameworks such as Airflow, Luigi, or similar
4+ years experience with Python and SQL
Bachelor’s degree in Computer Science or related field
Experience with systems for data processing (Spark, Flink, Hadoop, Airflow) and storage (S3, Kafka, ElasticSearch, Dynamo, MySQL, or Postgres) is a plus
Experience with ELK is a plus
Experience reading and optimizing data schema queries for content and performance
Experience working in agile project management methodologies (Scrum, Kanban)

Employer Details:
Onward Search is an equal opportunity employer, dedicated to a policy of non-discrimination in an employment with regard to race, color, religion, gender, sexual orientation, national origin, age, disability, genetic information, veteran status or any other classification protected by federal, state and local laws and ordinances. Candidates must be at least 18 years old to be considered for employment. EOE/M/F/D/V/SO.
In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification document form upon hire.
Onward Search offers medical, dental, vision benefits, as well as a 401k program, for all eligible full time temporary assignments.
Onward Search is unable to support 1099 / Corp-to-Corp or Independent Contractor arrangements at this time. All freelancers will be paid as W2 employees.
Onward Search is a drug-free workplace.

This job has expired.