Big Data Developer
高知特信息技术(上海)有限公司 Cognizant Technology Solutions
- 公司规模:1000-5000人
- 公司性质:外资(欧美)
- 公司行业:计算机软件
职位信息
- 发布日期:2019-07-11
- 工作地点:上海-杨浦区
- 招聘人数:若干人
- 工作经验:3-4年经验
- 学历要求:本科
- 职位月薪:1.5-2.5万/月
- 职位类别:软件工程师 高级软件工程师
职位描述
Role responsibilities:
· Design and implement data products and features in collaboration with product owners, data analysts, and business partners using Agile / Scrum methodology
· Contribute to overall architecture, frameworks and patterns for processing and storing large data volumes
· Research, evaluate and utilize new technologies/tools/frameworks centered around high-volume data processing
· Translate product backlog items into engineering designs and logical units of work
· Profile and analyze data for the purpose of designing scalable solutions
· Define and apply appropriate data acquisition and consumption strategies for given technical scenarios
· Design and implement distributed data processing pipelines using tools and languages prevalent in the big data ecosystem
· Build utilities, user defined functions, libraries, and frameworks to better enable data flow patterns
· Implement complex automated routines using workflow orchestration tools
· Work with architecture, engineering leads and other teams to ensure quality solutions are implemented, and engineering best practices are defined and adhered to
· Anticipate, identify and solve issues concerning data management to improve data quality
· Build and incorporate automated unit tests and participate in integration testing efforts
· Utilize and advance continuous integration and deployment frameworks
· Troubleshoot data issues and perform root cause analysis
· Work across teams to resolve operational & performance issues
- MS/BS in Computer Science, or related technical discipline
- 1+ years of experience in large-scale software development, 2+ years of big data experience
- Strong programming experience, Python or Scala preferred
- Experience designing, estimating and executing for complex software projects
- Extensive experience with Hadoop and related processing frameworks such as Spark, Hive, Storm, etc.
- Experience with RDBMS systems, SQL and SQL Analytical functions
- Experience with workflow orchestration tools like Apache Airflow
- Experience with source code control tools like Github or Bitbucket
- Experience with performance and scalability tuning
- Ability to influence and communicate effectively, both verbally and written, with team members and business stakeholders
- Interest in and ability to quickly pick up new languages, technologies, and frameworks
- Experience in Agile/Scrum application development
The following skills and experience are also relevant to our overall environment, and nice to have:
- Experience with Java
- Experience working in a public cloud environment, particularly AWS
- Experience with cloud warehouse tools like Snowflake
- Experience with messaging/streaming/complex event processing tooling and frameworks such as Kinesis, Kafka, Spark Streaming, Flink, Nifi, etc.
- Experience working with NoSQL data stores such as HBase, DynamoDB, etc.
- Experience building RESTful API’s to enable data consumption
- Experience with build tools such as Terraform or CloudFormation and automation tools such as Jenkins or Circle CI
- Experience with practices like Continuous Development, Continuous Integration and Automated Testing
These are the characteristics that we strive for in our own work. We would love to hear from candidates who embody the same:
- Desire to work collaboratively with your teammates to come up with the best solution to a problem
- Demonstrated experience and ability to deliver results on multiple projects in a fast-paced, agile environment
- Excellent problem-solving and interpersonal communication skills
- Strong desire to learn and share knowledge with others
公司介绍
Cognizant (NASDAQ-100: CTSH) is one of the world’s leading professional services companies, transforming clients’ business, operating and technology models for the digital era. Our unique industry-based, consultative approach helps clients envision, build and run more innovative and efficient businesses. Headquartered in the U.S., Cognizant is ranked 195 on the Fortune 500 and is consistently listed among the most admired companies in the world. Learn how Cognizant helps clients lead with digital or follow us @Cognizant.
高知特 —— Cognizant(NASDAQ-100:CTSH),是全球领先的信息技术专业服务公司,致力于帮助客户在数字时代打造新的商业模式、运营模式和技术模式。通过我们植根于不同行业、专业独到的咨询式服务,我们将帮助客户构想(Envision)和建造(Build)未来愿景,成就(Run)创新和高效的企业。高知特(Cognizant)总部位于美国,“财富” 美国500强企业中名列第195位,被评为全球最受赞赏的公司之一。欢迎访问公司主页了解更多有关高知特(Cognizant)的数字服务。
联系方式
- Email:yiruo@google.com
- 公司地址:前海深港创新中心a-2楼