Senior Software Engineer, Data Platform

| Greater Boston Area

Indigo is a company dedicated to harnessing nature to help farmers sustainably feed the planet. With a vision of creating a world where farming is an economically desirable and accessible profession, Indigo works alongside its growers to apply natural approaches, conserve resources for future generations, and grow healthy food for all. Utilizing beneficial plant microbes to improve crop health and productivity, Indigo’s portfolio is focused on cotton, wheat, barley, corn, soybeans, and rice. The company, founded by Flagship Pioneering, is headquartered in Boston, MA, with additional offices in Memphis, TN, Research Triangle Park, NC, Sydney, Australia, Buenos Aires, Argentina, and São Paulo, Brazil. www.indigoag.com

The Senior Software Engineer, Data Platform is a self-directed person passionate about database design performance at scale. This person can identify and working with data across a variety of formats and making the data available to an equally varied set of customers, from data scientists to web-based applications through APIs. They fundamentally understand big data ingestion techniques and the engineering necessary to push those frameworks to do more. This person is comfortable working with, deploying, and managing big data solutions using cloud based technologies.

 

Outcomes:

  • Collaborate with Data Management to provide tools and processes to validate and repair data
  • Delights users, across the organization by ensuring access to data that is necessary for those users to make informed decisions
  • Identify critical gaps and builds ETL processes
  • Domain expert in stored data and use cases
  • Implement / Design IoT Schema and Data Ingestion (w/ tests)
  • Finalize v1.x design and implementation for all R&D data

Competencies:

  • Understands implications of making various design decisions across a large dataset
  • Understands sparse data sets, storage mechanics, and the data needs for analytical applications
  • Understands trade-offs between multiple data formats (flat files, parquet, orc, etc.)
  • Understands data lifecycles (e.g. archiving, access, and cost of data management) and can manage / communicate these concern to the Architects and stakeholders.
  • Ability to work closely with the Data Science Group to understand their needs, enabling them to more effectively do their job by working with them to be able to access the data they require
  • Understands the need to pay significant attention to detail in software data management (e.g. data growth and monitoring, query performance awareness, data use cases) to be able to provide insight into problems before they are realized
  • Strong sense of quality and attention to detail
  • Willing to interface with many areas of organization to ensure our data is meaningful

Qualifications:

  • Experience designing schemas (DDL)
  • Experience architecting database topologies across a wide array of formats
  • Comfortable working with complex schemas and managing views into data
  • Knowledge of why/when to use no-sql, columnar, data sharding solutions
  • Experience with RDBMS (e.g. Postgres, MySQL, Oracle)
  • Working knowledge of at least one NoSQL database
  • Knowledgeable of in-memory database solutions
  • Experience in Restful API design
  • Experience in Java / Python programming languages
  • Experience writing high-performance data queries and associated database designs
  • Experience with data quality and ability to test that processes are correct
  • Experience w/ benchmarking and performance tuning data solutions
  • Knowledge of AWS data solutions (Spark / EMR / RedShift / Aurora / Athena)
  • Bachelor’s degree required, Master’s degree preferred
  • 7+ years of experience

 

Read Full Job Description
Apply now
loading ...
Emailed

Technology we use

  • Engineering
    • JavascriptLanguages
    • PythonLanguages
    • RLanguages
    • TypescriptLanguages
    • GraphQLLanguages
    • ReactLibraries
    • ReduxLibraries
    • ExpressFrameworks
    • Node.jsFrameworks
    • MySQLDatabases
    • PostgreSQLDatabases

Location

On the edge of Charlestown, we are within walking distance to restaurants and bars. The Sullivan Square T and bus stop is also right next door!

An Insider's view of Indigo

What projects are you most excited about?

Our mission is to provide agronomists with unbiased real-time data we are collecting across thousands of acres at the ground level and from space. It's such a thrill to be working on the data and analysis perspective of this massively cross-disciplinary team that helps agronomists initiate data-powered conversations to provide substantial results.

Jyoti

Principal Data Scientist

What makes someone successful on your team?

A successful Indigo team member is someone willing to continuously learn and improve, regardless of experience or role. Whether you’re an Engineer, Account Manager, Business Analyst, or Scientist, successful team members keep the bigger picture in mind and bridge disciplines to solve problems facing the incredibly complex system that is agriculture

Hilary

Software Product Manager

What are Indigo Perks + Benefits

Health Insurance & Wellness Benefits
Disability Insurance
Dental Benefits
Vision Benefits
Health Insurance Benefits
Life Insurance
Wellness Programs
Onsite Gym
Retirement & Stock Options Benefits
401(K)
Company Equity
Performance Bonus
Child Care & Parental Leave Benefits
Generous Parental Leave
Flexible Work Schedule
Vacation & Time Off Benefits
Generous PTO
Paid Holidays
Paid Sick Days
Perks & Discounts
Commuter Benefits
Company Outings
Stocked Kitchen
Some Meals Provided
Parking
Recreational Clubs
Relocation Assistance
Fitness Subsidies
Professional Development Benefits
Job Training & Conferences
More Jobs at Indigo43 open jobs
All Jobs
Finance
Data + Analytics
Design + UX
Dev + Engineer
Internships
Marketing
Operations
Product
Project Mgmt
Sales
Operations
new
Boston
Data + Analytics
new
Boston
Internships
new
Boston
Internships
new
Boston
Internships
new
Boston
Internships
new
Boston
Finance
new
Boston
Internships
new
Boston
Internships
new
Boston
Data + Analytics
new
Boston
Project Mgmt
new
Boston
Data + Analytics
new
Boston
Data + Analytics
new
Boston
Developer
new
Boston
Project Mgmt
new
Boston
Developer
new
Boston
Design + UX
new
Boston
Developer
new
Boston
Data + Analytics
new
Boston
Developer
new
Boston
Developer
new
Boston
Product
new
Boston
Project Mgmt
new
Boston
Marketing
new
Boston
Product
new
Boston
Data + Analytics
new
Boston