EY - GDS Consulting - AI And DATA - GCP - Manager

At EY, youll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And were counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. The opportunity We are seeking an experienced GCP Data Architect to design and implement scalable cloud-native data platforms, data lakes, and enterprise data warehouse solutions on Google Cloud Platform (GCP). The candidate will be responsible for defining/evaluating architecture standards, designing data integration frameworks, guiding engineering teams, and delivering business-focused analytics solutions Your Key Responsibilities Design and implement enterprise-scale Data Lake and Data Warehouse solutions on GCPWell-versed with ETL process- SCD handling, incremental and historic loads, Failover processing, recovery and reprocessing of data pipelines, Data quality framework and controls Define end-to-end data architecture (Lakehouse, event-driven) including ingestion, transformation, governance, security, and consumption layers Develop cloud-native data integration solutions using Google Cloud servicesArchitect data pipelines for multiple source systems such as fund administrations, SQL Server, APIs, and external platformsDesign and develop pub/sub ingestion streamsImplement data profiling, data quality, encryption, and compliance controls using GCP-native services.Establish orchestration frameworks and workflow automation strategies using Cloud Composer and Airflow Lead solution design reviews and provide technical guidance to development teams Collaborate with business stakeholders to translate business requirements into scalable data solutions. Present architecture solutions to internal leadership and client stakeholder Design & implement data mart (foundational and consumer marts) Other Responsibilities Implement design level technical best practicesInterface and communicate with the client team and onshore coordinatorsCompletion of assigned tasks on time and regular status reporting to the leadAgree on level of documentation with clients and track to sign of them.Work with client on design approvals.Help client select tools and technologies necessary for the scope of the project.Define and develop client specific best practices around data management within a cloud environmentRecommend design alternatives for data ingestion, processing and provisioning layersDesign and develop data ingestion programs to process large data sets in Batch mode using Spark, or similar technologies Required Skills (Mandatory) Strong understanding & familiarity with all GCP ecosystem componentsStrong understanding of underlying GCP Architectural concepts and distributed computing paradigmsHands-on programming experience in Apache Spark using Python/Scala and Spark StreamingHands on experience with major big data components in GCP like GCP Data Proc, Big Query, Google Pub Sub, Google Data FlowExperience in designing and implementing data marts (foundational and consumer marts)Hands-on experience on SQL and DatawarehouseExperience working with NoSQL in at least one of the data stores like GCP Firestore, GCP Datastore, GCP Big Table or MonogBD ATLASKnowledge of Spark and Kafka integration with multiple Spark jobs to consume messages from multiple Kafka partitionsSolid understanding of ETL methodologies in a multi-tiered stackFamiliarity with financial data products and domains- preferably asset wealth management data products (public/private markets)Experience in converting business problems/challenges to technical solutions considering security, performance, scalability etc.Experience in Enterprise grade solution implementations.Experience in performance bench marking enterprise applicationsExperience in Data security [on the move, at rest]Experience in Scheduler/Orchestration tools like Airflow or CloudComposerExperience/exposure to building CI/CD pipelines and containerization (Docker, K8s etc) Your People Responsibilities Should guide and mentor fresh team members on Cloud technology- GCPCreate a well-informed cloud data strategy and manage the adaption processOffer guidance in infrastructure movement techniques including bulk application transfers into the cloudProvide prompt response to technical issues in a professional mannerLead a team Qualifications Minimum of 10 years of experience in data spaceShould have completed at least 3 full life cycle experience in Cloud projectsMust have at least 7+ years of deep experience in Cloud implementationsDesign, develop and implement datalake designs from the ground up to stage, modify and load data received from various sourcesFlexible and proactive/self-motivated working style with strong personal ownership of problem resolution.Excellent communicator (written and verbal formal and informal).Ability to multi-task