Report this job

---

What is the problem? *

Incorrect company
Incorrect location
Job is expired
Job may be a scam
Other

POSITION: DATA SCIENTIST (#269467E)
LOCATION: BOSTON, MA

Will design the ETL pipeline required to satisfy the requirements of the problems encountered in the telematics data. Writing test cases to check the health of the pipeline to run the entire code successfully. Run the pipeline data based on the schedule and frequency needed for a specific application. Discussing with our cross-functional teams and helping the applicated to be automated with optimized python libraries. Deliver the delta changes happened with existing data source and new data sources. Collecting the statistical information and using it in our automated solution development to manage data profiling. Design the data flow diagrams to provide in depth data visualization and process the flows Spark Databricks and other data visualization tools. Will design the database structure that relates to the schema structure. Developing new flat tables to prolong our table structure and implement new spark operations to deliver machine uptime to our customers. Prepare the Physical model to indicate Cardinality Ratios between the entities or Nullability of the relationships, define access profiles, and authorizations on the Database objects, provide details of data storage or technology to be used in the project. Troubleshoot the telematics data changes happening with dealers. Rectify the problems encountered with our designed database solutions and cross checking with our solutions to be accurate for delivering back to dealers. Prepare high-level design that would define the standard data Extract transform & load pattern to be followed based on the source and target. Determining what are the Attribute views, Analytic views and Calculation views to be created under the schema based on the available data objects. Will create mapping documents that defines the data transformation rules that maps from source to target data based on the Physical Database model designed. Create new tables/stored procedures to establish relation between the existing data elements. Defining primary, composite keys to validate the data down the line. Defining change data capture methods and migration strategies. Create documents for the stories completed. Providing the documents in words and queries to understand the business users of the work involved. Documenting regular installation packages for the users in google docs and modifying it whenever there is a new change happens. Write new solutions for data integration issues. Making changes in Pyspark scripts, comparing it the Cluster utilization and cross checking of the impact in the CPU. Optimizing these changes when needed for a big spark application.

Position requires up to 100% domestic travel. This position is for full-time, salaried (W-2), permanent employment.

REQUIREMENTS:

Position requires a Master’s Degree or foreign equivalent in Computer Science, Information Technology, or a related field and two (2) years of experience in the Software Industry.
Please Reference Job Number #269467E when sending resumes. Please mail resumes to: HR, Beacon Hill Staffing Group, LLC, 152 Bowdoin Street, Boston, MA 02108.