北京 [切换城市] 北京招聘北京计算机软件招聘北京高级软件工程师招聘

ETL开发工程师

上海华钦信息科技股份有限公司

  • 公司规模:1000-5000人
  • 公司性质:合资
  • 公司行业:计算机软件

职位信息

  • 发布日期:2017-08-01
  • 工作地点:上海
  • 招聘人数:4人
  • 工作经验:3-4年经验
  • 学历要求:本科
  • 语言要求:英语 熟练
  • 职位月薪:1.5-2.2万/月
  • 职位类别:高级软件工程师  

职位描述

职位描述:
Job Description

? Works with PayPal business units and Product Dev teams to design, develop and deliver data solutions on one of the largest data platforms in the world.
? Supports PayPal business units by providing data in a ready-to-use form to data analysts and data scientists for Business insights, predictive analytics, machine learning, etc.
? Owns and is accountable for the design and development of a Data solution feature or a Data Pipeline.
? Spends most of the time developing data pipelines/ETL code for solving various data requirements using traditional ETL tools but also has experience & skills for building custom data pipelines.
? Code is well-commented, easy to maintain, and can be reused across a sub-system or feature. Code may persist for the lifetime of a software version
? Code is thoroughly tested with very few bugs, and is supported by unit tests.
Beginning to lead feature or sub-system design reviews and code reviews and be recognized as the go-to developer for that component.
? Recognized as the go-to developer for a product or major sub-system and is seen as a leader in their specialized field.
? Leads feature or component design reviews and code reviews and is fully recognized as the go-to developer for that component.
? Participates in architecture discussions, proposes and discusses solutions to system and product changes that are directly related to their area of focus.
? Responsible for managing multiple Applications, providing necessary support and maintenance activities.
? Should be comfortable working in an agile environment and with cross-functional teams, should have appetite to learn and be flexible to pick up new technology.


Requirements
? EE/CS or related majors. Bachelor and above.
? 5+ years working in data engineer or a similar role in large enterprise data warehouse teams preferred.
? Can be relied on to deliver a data pipeline on time and to requirements, without data quality issues.
? Leads the team, and contributes effectively to the success of those that they interact with regularly.
? Can triage and resolve data / process issues
? Able to evangelize best practices through prototyping or other means.
? Helps to resolve site data base issues and SLA, ATB impacts.
? Good understanding of Data Modelling Concepts, experience with modelling data and metadata to support relational & non relational database implementations; experience with building Logical and Physical data models.
? Familiar with various big data technologies, open source data processing frameworks.
? Evaluates and implements data solutions with various big-data technologies.
? Good understanding of data processing, data structure optimization and design for scalability.
? Optimize ETL processing of extremely large datasets; Optimization for SLAs
Good understanding of REST-oriented APIs , understanding of distributed systems, data streaming, NoSQL solutions for creating and managing data integration pipelines for Batch and Real Time Data needs.
? Excellent communication and team player skills to collaborate with cross functional teams for successful delivery of Data solutions.
? Understanding of version control systems, particularly GIT.
? Strong analytical and problem solving skills.
? Good understanding of database principles and SQL beyond just data access.
? Expert in multiple Programming/scripting languages, i.e.Unix/Linux Shell Scripting, Perl, Python, C++, Java, Python, Ruby, Scala,etc

? Intermediate level knowledge on following technologies, with expertise on few of them:?
o Spark with Python or Scala?
o HBase
o Hive/Pig
o scripting(Shell, Python, Java)
o database fundamentals(Oracle or Teradata)
o Hadoop echo system
o Elastic search

? Intermediate level knowledge on following business domains is a plus:
o Marketting
o Customer Service
o Payments
o Merchant servicing
o e-commerce
? Excellent oral and written communication skills in English.

职能类别: 高级软件工程师

关键字: ETL DW SQL

举报 分享

公司介绍

华钦科技集团公司
华钦科技(纳斯达克股票代码:CLPS)成立于2005年,总部位于中国香港,是一家专注于银行、保险和金融领域的全球领先的信息技术(“IT”)咨询和解决方案服务提供商。
十多年来,华钦科技已将服务网络扩展至全球金融行业的客户,包括来自美国、欧洲、澳大利亚和中国香港的大型金融机构及其设在中国大陆的IT中心。华钦科技目前拥有技术人才超三千名,有19所交付和研发中心来服务于不同地区的客户,中国大陆的交付和研发中心位于上海、北京、大连、天津、保定、西安、成都、广州、深圳、杭州和海南,国际交付和研发中心分别位于中国香港、美国、英国、日本、新加坡、马来西亚、澳大利亚和印度。
华钦科技将现场支持咨询与可扩展的离岸服务相结合,以低成本的方式快速满足客户的需求,同时保留了业务灵活性,通过提供一站式金融解决方案,满足客户对于人才创造和发展的需求,打造出独特的市场优势。
华钦科技为客户提供全方位的金融技术服务和解决方案,在信用卡、银行核心系统、网上银行等金融科技领域的经验尤为丰富,所拥有的信用卡产品(Vision Plus)技术团队、IBM大型机技术培训及实施团队在国内同行中是最具规模的团队之一。
华钦科技通过ISO9001(金融业软件开发和设计)、ISO14001、ISO27001、CMMI 5认证,获“双软”企业、高新技术企业、科技小巨人培育企业、上海市服务外包重点企业、上海服务外包人才实训基地等认证。
华钦科技秉承“以人为本、坦诚勤奋、认真负责”的团队精神,尤为重视IT人才的发掘和培养。公司实施成熟的培训计划,包括技术领域、管理领域、英文口语、职业规划等方面培训课程,帮助员工快速融入到项目中,在实际项目中也不间断提供给员工出国学习和国外项目实施的机会,提升员工自身能力,增加公司竞争力。

CLPS Incorporation
Headquartered in Hong Kong SAR, CLPS is a NASDAQ-listed (Nasdaq: CLPS) and global information technology, consulting and solutions service provider focused on delivering services to global institutions in banking, insurance and the financial sectors, both in China and globally.
For more than ten years as an IT, business know-how and talent solutions provider for such clients, CLPS has expanded its service network to clients in the global financial industry, including large financial institutions from the US, Europe, Australia and Hong Kong and their PRC-based IT centers. We have more than 3,000 employees and maintain 19 delivery and R&D centers, of which eleven are located in mainland China and eight globally, to serve different customers in various geographic locations.
By combining onsite and onshore support and consulting with scalable and high-efficiency offsite and offshore services and processing, we are able to meet client demands in a cost-effective manner while retaining significant operational flexibility. CLPS has created and developed a particular market niche by providing turn-key financial solutions as well as supplying its clients’ needs for talent creation and development.
CLPS is dedicated to providing a full range of services and solutions across technology needs in finance. In recent years, we have both one of the largest IBM mainframe teams, and the largest VisionPLUS team in China, providing both development and implementation of core banking, credit card, online and e-commerce systems, as well as expertise across technology stacks.
We are ISO9001, ISO14001, ISO27001 and CMMI 5 certified, and have been granted certificates of recognition by the Shanghai government, including Enterprise Software Certification, High-tech Enterprise, Little Giant Company for Science and Technology and Professional Talent Development Training Camp.
We strive to foster a spirit of openness, diligence, sense of responsibility and a people-oriented attitude. Our growth is created by our people, creating a win not just for clients, but a win-win for clients and us all, through training and opportunities for development at every stage in our staffs’ career - new and deeper insight to technologies, business, management, language, university cooperation, certification and international opportunities.

联系方式

  • Email:cassie.xu@clpsglobal.com
  • 公司地址:地址:span天河路533号