|
Search Jobvertise Jobs
|
Jobvertise
|
Data Engineer Location: US-MA-Boston - 02108 Jobcode: #471542 Email this job to a friend
Report this Job
POSITION: DATA ENGINEER (#471542)
LOCATION: BOSTON, MA
Will manage and optimize components of the ecosystem, querying structured data. Ensure data availability, reliability, and performance. Leverage strong programming skills in Python/Scala and PySpark/Scala Spark to develop custom data processing scripts, automate ETL tasks, and optimize data workflows for performance and scalability. Work with both SQL and NoSQL databases, designing and optimizing data storage solutions. Ensure data integrity, consistency, and efficient retrieval for data consumers. Collaborate with data scientists, analysts, and other cross-functional teams to understand data requirements and provide reliable and well-documented data solutions. Continuously monitor and optimize data pipelines and processing jobs for performance and cost efficiency, making necessary adjustments as needed. Maintain detailed documentation of data engineering processes, data sources, and data lineage to facilitate troubleshooting and knowledge sharing within the team. Keep abreast of the latest trends and advancements in data engineering, cloud technologies, and big data solutions to recommend and implement improvements to existing data infrastructure. Troubleshoot and resolve data-related issues promptly, identifying root causes and implementing solutions to prevent recurrence.
Position requires up to 100% domestic travel. This position is for full-time, salaried (W-2), permanent employment.
REQUIREMENTS:
Master’s Degree or foreign equivalent in Computer Science, Information Technology, or a related field.
Please Reference Job Number #471542 when sending resumes. Please mail resumes to: HR, Beacon Hill Staffing Group, LLC, 152 Bowdoin Street, Boston, MA 02108.
HR
Beacon Hill Staffing Group, LLC
152 Bowdoin Street Boston, MA 02108
|