Job Description
Overview This is a provisional appointment.
Job Description Brief Job Description (essential functions of the job): The Department of Innovation and Technology is looking for a Junior Data Engineer to join our growing Citywide Analytics Team.
As part of a highly collaborative group using data to improve all aspects of city government, the Junior Data Engineer will work on expanding our data infrastructure, developing ETL pipelines and open datasets, and connecting our analysts and data scientists to the data they need. Successful candidates will be able to work closely and collaboratively across the Analytics Team as well as with data owners within city departments. They will have familiarity with data engineering principles and processes and be able to work on a wide range of projects and with a variety of tools. Loving city government is preferred!
The Citywide Analytics team is a diverse group of analysts, data scientists, project managers, developers, and engineers with a range of skills and backgrounds, working together to use data to improve life for those who live and work in Boston. The Junior Data Engineer will fulfill the responsibilities listed below and bring a collaborative spirit that will strengthen and expand the team’s overall range of abilities.
Responsibilities - Process new datasets, including finding syntax or logical errors in the data and working with data owners to understand the specifics of the data.
- Set up and update automated extract, transform, and load (ETL) workflows.
- Automate existing processes and integrate new data sets.
- Maintain and curate the documentation surrounding the team’s data inventory - including adding new documentation, working with data owners to provide more thorough documentation, and updating the documents to reflect any changes to the dataset.
- Provide support to more senior engineers working on automation or integration efforts.
- Maintain a diagram of existing data pipelines and their dependencies, including datasets and reports. Work closely with engineers and analysts to maintain the most updated version of the diagram and include new work on it.
- Work closely with data owners to resolve any potential errors or confusion identified by analysts working on the data.
- Assist other team members in locating the most appropriate dataset to use for their project, including both spatial and tabular data.
- Help users install tools such as ArcGIS and SQL database clients on their desktops and set new users up with correct access levels. Maintain the install files for the latest approved version.
- Assist department personnel with the writing of queries for reports and analytics, making sure the business logic assumptions made in the query are aligned with the data.
- Provide oral and written reports and presentations clearly, concisely, and effectively.
- Perform related work as required.
Minimum Entrance Qualifications - At least two (2) years of full-time, or equivalent part-time, experience working with data analysis projects in a business, government, or nonprofit setting.
- A bachelor's degree in economics, computer science, social science, engineering, mathematics, public policy, business, or a related field is preferred and may be substituted for up to two (2) years of the required experience.
- Knowledge of Python or shell scripting.
- Experience cataloging or curating knowledge bases or writing documentation is preferred.
- Experience cleaning up and standardizing datasets from various source systems.
- Knowledge of and experience using SQL.
- Knowledge of Github or other code management repository tools is preferred but not required.
- Some knowledge of GIS concepts and experience working with spatial data is preferred, but not required. Includes experience with ArcGIS product suite and/or knowledge of PostGIS.
- Strong analytical, problem-solving, and communication skills, including mapping of specific business needs to appropriate solutions in a data-focused context.
- Demonstrated success in learning new skills as needed to succeed in a fast-paced environment.
- Talent for explaining complex subject matter to both technical and non-technical audiences.
- Ability to exercise good judgment and focus on detail as required by the job.
Boston Residency Required Terms: Union/Salary Plan/Grade: SENA/MM1-6
Hours per week: 35
Job Tags
Full time, Part time,