Job List

This job made me think of you.

I’m interested
Being referred by another tech person is best. Copy this link, and send it to a peer along with your resume. Ask them to refer you.

Scala/Big Data Engineer

Referral Payout: $7000

Employer: Strategic Data Systems

Position: Scala/Big Data Engineer

Salary: $95,000 - $125,000

Location: Dayton or Cincinnati, Ohio

Position Type: Direct Hire, Full-Time



Full Description

Strategic Data Systems is a software development company with dev centers located in Cincinnati and Centerville, Ohio. We serve top companies headquartered in Cincinnati, Dayton and Columbus, Ohio as well as others located around the United States. Top developers are drawn to us because the work we do is both interesting and challenging. If that appeals to you please read on.

RESPONSIBILITIES:

Our client develops the legal profession’s most innovative products for legal analytics and research, using the latest in visualization and text mining. Lawyers use these products to forecast how judges will rule, find critical cases, and make data-driven decisions. We're working with great technology and the challenges that get us fired up involve large-scale heterogeneous text
and data mining, beautiful UI, and machine learning. .

This position will assist with performance enhancements on its production system.  The current ingestion process has an involved pipeline that goes through many steps and takes about 1 week of processing to complete.  The client needs this process to take significantly less time.

Some of the challenges are:

The amount of work done in the pipeline and this work is serialized.  Perhaps there is an opportunity for streaming or parallel processing

    • AWS cost/spend is always a concern
    • There may be some event processing in the system, but there is a belief that more processing would be better.  SQS or Kafka would be potential fits here.
    • There is a graphing API that is lightweight, and it needs optimized as well.  Mostly around the processing.  This is a containerized application written in Scala.
What you will be doing:
    • Build and scale data infrastructure that powers real-time data processing of billions of records in a streaming architecture
    • Build scalable data ingestion and machine learning inference pipelines
    • Build a general-purpose API to deliver data science outputs to multiple business units
    • Provide visibility into the health of our data platform (comprehensive view of data flow, resources usage, data lineage, etc) and optimize cloud costs
    • Automate and handle the life-cycle of the systems and platforms that process our data

QUALIFICATIONS:

  • Passion for big data and creative ideas for what to do with it
  • Experience with the algorithms and data structures to make your ideas workable
  • Expertise in any of the following programming language: Scala (strongly preferred), Java, C++, Python
  • Experience working with data technologies that power analytics (e.g. Hadoop, Spark, Kafka,
  • Docker, Kubernetes, etc).
  • Knowledge of data modeling and database technology (Graph database, knowledge graph expertise strongly preferred)
  • Familiarity with Cloud solutions (AWS, GCP, Azure) Understanding of machine learning

ABOUT Strategic Data Systems:

Strategic Data Systems has been a valuable part of the Information Technology community in southwest Ohio since 1992. We take pride in hiring superstar software developers and we value building professional relationships with employees, customers, and the greater IT community. We work with companies across the country, but focus our efforts in southwest Ohio, northern Kentucky, and southeast Indiana.

At SDS,  personal connection meets enterprise level scale. We build deep relationships with our clients in a wide range of industries, while sharing insights across markets to bring the full breadth of our expertise to every engagement. Our two regional Development Centers are hubs for innovation, attracting top talent to rapidly co-create – with our clients – the technology products of tomorrow.

Refer a friend

Submit Your Resume

© . Recless Tech. All Rights Reserved.