Senior Data Engineer
Oakland, CA 
Share
Posted 1 day ago
Job Description
Description
Position at Matson Navigation Company, Inc

About Us

Matson has been the leading ocean shipping and logistics provider throughout the Pacific since 1882. We are the supply chain lifeline for Hawaii, Alaska, Guam, and islands of the South Pacific. We also offer the top two ocean shipping services in the world's largest trade lane - Asia to the U.S. West Coast. With our subsidiaries Matson Terminals and Matson Logistics, our business focus is exceeding customer expectations with quality, reliability, and integrity.

We strive to operate in an environmentally sustainable manner and promote land-based environmental programs in Hawaii, Guam, and Alaska. We help improve the communities in which we work and live through our community giving program that annually supports hundreds of local organizations. And we work to improve diversity, equity and inclusion in our company, communities and industry through an active social equity program.

Matson is a great place to work, and everyone who works with us becomes part of the Matson ohana or family. Join our team and help us move freight better than anyone.

Learn more at matson.com.

About the Role

The Senior Data Engineer is a member of the Data Services team within IT Services. The individual is responsible for developing, constructing, testing and maintaining processes and architectures that support large scale big data processing operations, data administration, data security administration, data lake space management, data performance optimization, data lake backup and restore, installation that support data lake administration, and 24/7 support of the organization's data across multiple big data platforms and computing environments; participates in data recovery measures and data integrity checking; supports the production operations and applications development teams; monitors data access for resource utilization and forecasts future resource requirements; schedules and performs upgrades; and completes required logs and reports of maintenance activities. The individual participates in the development of data management policies and standards; provides in-depth consulting services in the identification and resolution of data issues; and participates in the planning, design, and usage of data resources. The individual is responsible for adhering to Matson's standards and would participate in incorporating industry best practices into data administration and management activities. This individual is expected to have a good understanding of Matson's operations procedures and business applications; and be responsible for maintaining documentation and implementing processes that meet the IT general control normative model to ensure SOX compliance. The incumbent is expected to learn the business practices of his or her customers within all business units and implement appropriate big data support solutions and processes to meet business requirements.

What you'll do:

  • Work as a general administrator providing support for production, development, and QA big data platforms.
  • Manage big data, data lake, data mart, data warehouse and reporting (canned/ad hoc/business intelligence) administration.
  • Work with the data architecture team, application architecture team, development teams, QA team, and production operations to implement systems in production.
  • Manage big data software installations, configurations, patches, upgrades, and other related activities.
  • Manage big data, data lake backups and restores.
  • Develop, maintain, and publish disaster recovery plans, system requirement definitions, technical evaluation reports, operations readiness plans, capacity planning documents, and security administration procedures.
  • Set up access privileges to big data and data lake sources and create user security profiles.
  • Monitor data lakes for resource utilization.
  • Provide trend analysis for forecasting future resource requirements.
  • Monitor and optimize the use of disk space.
  • Initiate corrective action to ensure all big data servers meet processing requirements for performance and reliability.
  • Provide recommendations on hardware and software upgrade alternatives.
  • Conduct software audits of big data products for compliance with established standards, policies, configuration guidelines and procedures.
  • Meet or exceed mutually established key objectives.
  • Follow and enforce IT corporate standards and policies.
  • Provide support to in-house and remote personnel.
  • Collect and assimilates information to analyze a problem or requirement to determine the best technical solution. Evaluate alternatives, including new technology.
  • Work collaboratively with other members of the development team, other IT Services teams, and business stakeholders.
  • Perform as an active participant of the team and contribute to building a positive team spirit.

You have these skills:

  • Ability to maintain high levels of internal customer satisfaction with utmost respect and dedication.
  • Excellent interpersonal skills, both verbal and written communications.
  • Ability to maintain high level of technical skills and strive to expand on technical knowledge through self-education or company provided education.
  • Proven troubleshooting abilities and experience applying upgrades/patches on production environments.
  • Experience rolling out new systems into production as well as upgrading production systems while maintaining availability in an enterprise environment.
  • Ability to identify and resolve problems in a timely manner; assess facts; provide alternatives.
  • Ability to mentor and provide guidance for teammates, facilitating individual development.
  • Ability to encourage quality and process improvement
  • Responsive to problems and requests identified by the business owners. Able to solicit customer feedback to improve service; meet commitments.
  • Set and achieve challenging goals; demonstrate persistence and overcomes obstacles.
  • Follows direction, responds to management direction; takes responsibility for own actions; commits to long hours of work when necessary to reach goals; completes tasks on time or notifies appropriate person with an alternate plan.
  • Demonstrate accuracy and thoroughness in resultant work product; look for ways to improve and promote quality; apply feedback to improve performance; monitor own work to ensure quality.

And these qualifications:

  • Bachelor's degree (B.A. or B.S) from an accredited college or university.
  • Minimum eight (8) years of experience in the administration and support of production Big Data, Analytics and Web applications in an enterprise environment.
  • Successful history of acting as the Data Engineer or Big Data Analytics Administrator on full life-cycle applications development projects, packaged software implementation projects, and data warehousing projects.
  • Experience with Big Data Management techniques including logical data modeling, physical data lake optimization, data distribution, and data lake and data hub performance monitoring and tuning.
  • Knowledge of Oracle, MySQL and SQL Server Databases, JBoss Platform, RHEL, Windows Servers, Java, Python, Scala, SQL, Shell Scripting, and file transfer tools.
  • Knowledge of DB Design tools such as Embarcadero E/R Studio.
  • Knowledge of Business Intelligence tools such as ELK/Kibana, Tableau, Splunk, AWS Big Data Services such as EMR, Kinesis and Open Source Apache Big Data tools such as Hadoop, Hive, Spark and Kafka are highly desirable.
  • Knowledge PostgreSQL and Cloud Relational Database Services such as AWS Aurora and RDS are highly desirable.
  • Knowledge of NoSQL Data Bases such as AWS DynamoDB is highly desirable.
  • Knowledge of Data Science and Data Transformation Automation frameworks such as Alteryx, UIPath, Talend ETL are highly desirable.
The annual salary range for this position in California is $101,600 - $138,200. The salary offered will depend upon qualifications and other operational considerations.

At Matson, we're looking for people to build a unified team to maintain our values of trust, integrity, and reliability. We welcome diverse perspectives and people who think rigorously and thoughtfully challenge assumptions.

#MI

Matson is an equal opportunity employer committed to a diverse and inclusive workforce. Applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy), age, sexual orientation, national origin, marital status, parental status, ancestry, disability, AIDS/HIV status, gender identity, gender expression, veteran status, genetic information, other distinguishing characteristics of diversity and inclusion, or any other protected status. Qualified applicants with arrest and/or conviction records will be considered for employment in a manner consistent with federal and state laws, as well as applicable local ordinances, including, but not limited to, the San Francisco and Los Angeles Fair Chance Ordinances.


All qualified applicants will receive consideration for employment without regard to race, sex, color, religion, national origin, protected veteran status, or on the basis of disability.

 

Job Summary
Start Date
As soon as possible
Employment Term and Type
Regular, Full Time
Required Education
Bachelor's Degree
Required Experience
8 years
Email this Job to Yourself or a Friend
Indicates required fields