Samir - Data & DevOps Engineer

Ref : 160202G002
Email vérifié
Photo de Samir, Data & DevOps Engineer
Compétences
JAVA
SAP
SAP HANA
APACHE HADOOP
DEVOPS
ANSIBLE
AZURE
APACHE SPARK
APACHE HIVE
PYTHON
Expériences professionnelles

  • Function: Devops & data engineer

    Client : Électricité De France - Paris
    Jan 2018 - aujourd'hui

    Project: DevOps Big Data
    Mission: Set up a DevOps tool for Big Data applications
    The goal of the mission is to set up a Devops deployment system for Big Data treatments.
    Deploy the solution within all EDF units with support and project training
    The mission within the project consists of:
     Create, industrialize and automate bigdata infrastructure projects in Infra As code
     Set up the CI/CD pipeline on projects with tests, validations, security
     Propose and implement architectural developments in conjunction with the architects
     Guarantee the security of project data by implementing the right protection mechanisms
     Participate in the study, costing, framing in connection with architects and project managers
     Take charge of all BUILD and RUN aspects (You build it, you run it)

    Environment: Ansible, Jenkins, Git, Groovy, Docker, Kubernates, Ambari, Ranger, Kerberos, Cloudera, Knox, Spark, Hive, Linux, Yaml,, Python, Scala, Java, Shell

  • Function: Data & Devops Engineer

    Client : Crédit Agricole - CACEIS– Paris
    Jan 2018 - Jan 2018

    Project: Set up a Data-Lake
    Mission: Architect, Hadoop Administrator, Data-Lake, DevOps
    The objective of the mission is the definition of the architecture of the new datalake, then the implementation and
    management of the Big Data HortonWorks infrastructure and also the implementation of a security policy and
    data governance.
    The mission within the project consists of:
     Definition of the technical architecture
     Setting up the technical infrastructure
     Installation, configuration of software bricks: Hortonworks, Talend BigData, Vertica, Attunity
     Connect all components and make them work together
     Hortonworks Hadoop Administration
     Configuration and customization of Big Data security
     Set up the CI / CD installation pipeline with tests, validations, security
     Automation of the installation of infrastructure components with Ansible

    Environment: Hortonworks, Ambari, Ranger, Ansible, Jenkins, Kerberos, Talend Big Data, Attunity Replicate, Kafka, Vertica, Spark, Hive, Shell Linux

  • Function: Big Data Engineer

    Client : Société Générale - Paris
    Jan 2017 - Jan 2019

    Project: Compliance
    Function: Big Data Engineer
    Mission: Data Analyzer / Big Data Developer
    The client has a global responsibility for all IT tools for market abuse control, compliance, and operational risk. In
    addition to this direct responsibility, it is also possible that the steering projects executed in other related entities.
    The Project Objective is the implementation of solutions based on Hadoop stack: Hortonworks distribution,
    parquet storage, un-normalization in HIVE, SOLR indexing, the use of SPARK / Java for distributed process, the
    use of oozie and spring also, data-visualization with Tableau Software.
    The mission within the project consists of:
    Analysis and design of the big data solution to put place
    Loading data in the DataLake
    SPARK / JAVA development of new detection patterns
    Restitution via a WEB interface or the TABLE software tool
    Development and calculation of KPI / KRI
    Indexing data with SOLR

    _Hadoop Hortonworks, Java, Python, Spark, Hive, Hue, Keberos, Parquet, ElasticSearch, SolR,Shell Linux, WSRest

  • Function: Data Engineer & Data Scientist

    Certificate Data Science - University Paris Dauphine - Paris
    Jan 2016 - Jan 2016

    Project: Amazon open data project
    Mission: Exploration of the data and analyzes feelings (Opinion of the Amazon customers)
     Development of several algorithms on Apache Spark by using the functional language Scala
     and Python
     Implémention of the algorithms by using the language R with RStudio
     Loading of the data by using Pig/Hive /Impala on a distribution Hadoop Cloudera
     Development of a MapReduce program in Java to make statistics on the basis of
    data
     Construction of the whole of the characteristics to lead classification, by using them
    methods of text mining
     Proposal and use for a set of learning techniques supervised (trees of
    decision, random forests, svm, bayesien naive) to build a model of analysis of feeling.
     Proposal for a set of measurements to compare the performances of these methods (accuracy, precision,
    recall, F-measurement, ROC, AUC).
     Calculations were carried out on a cluster composed of 10 waiters, of which storage capacity
    live reached 40 GO of RAM by waiter and the total secondary storage capacity of the cluster reaches 10 TO.

    _Hadoop Cloudera, Spark, Yarn, MapReduce, Python, Java, Hive, Pig, Impla, Sqoop, Language R,RStudio, Learning Machine, Scala, Elastic Search, Neo4j

  • Function: Data engineer

    Electricité de France - Paris
    Jan 2015 - Jan 2017

    Project: Projects under HADOOP
    Mission: Architecture and development Big data
    For projects of the department “EDF data warehouses”, that is brought to conduct many studies of architecture
    then to implement these studies of architecture within the framework of operational projects.
    For example: Installation of Kafka/Spark within the framework of a brick of acquisition at the current, put in work
    of ELK for the acquisition of log and bricks of reporting.
    The mission within the project consists with:
     To carry out the studies of architectures big dated in support with the architect referent from the department.
     To carry out in a specific way of the developments to implement these architectures.
    Projects carried out:
     Accosting of new a CRM (MY) to the Big platform Dated, Vue customer 360°: real time with Kafka and
    Spark Streaming, storage and indexing in HBase and ElasticSearch, alignment customer with Comscore and
    WebAnalytics
     Creation of a reference frame for the eligible customers with the electronic invoice (AIFE Chorus): Spark
    batch, Apache Nifi, HBase, Java, XML
     Development of several batchs, Hive, Spark, for the integration of data of several applications in the platform
    Hadoop (Linky, GazPar, Comscore…)

    _Hadoop Hortonworks, HDFS, Spark, Yarn, MapReduce, Hive, Pig, Hoot, Sqoop, RStudio,ElasticSearch, HBase, Linux, Keberos, Ranger, Python, Java, Scala

  • Function: Technical Engineer

    ACCENTURE- ERDF (Electricity Network Distribution of France) - Paris
    Jan 2012 - Jan 2016

    Project: SOA portal
    Mission: Technical Lead and SOA Architect

     Participation in the installation of the technical architecture of the project in collaboration with
    Basis teams, Architecture and Interfaces
     Participation in the drafting and the update of the document of technical architecture (DAT)
     Configuration of WebDispatcher (Load-balancing), to improve the performances
     The installation of the environments (Dev., test, preprod, prod), Unix, Oracle, RAC, SAP…
     Administration of the waiters of application WAS
     Administration of the environment of development
     Drafting of the SFD and Standard and TUFF, YOU
     Formative expert/(2 developers) on technologies /J2EE Java
     Piloting of several developers onshore and offshore oil rig in a SOA context 4 layers
     Definition of the best practices project
     Design object and development of the microphone-services in Java
    Context:
    The infrastructure of the project is based on the structuring principles of the High Availability and the replication,
    based on the fault tolerance of a principal site and a recovery plan of activity on a site of help. With this intention,
    the infrastructure put in work rests on two rooms for the principal site and of a room in a site of distant help.

    _Java, SOA, Microphone-services, Unix, Oracle, VMware, WebDispatcher, SAP, Visual Tocompose, LoginModule,

  • Function: Development Engineer

    ACCENTURE - ERDF (Electricity Network Distribution of France) - Paris
    Jan 2011 - Jan 2011

    Project: Processing data of counting and publication flows (Data-processing Direction and telecommunications)
    Mission: Technical Lead
     Framing of the development team
     Participation in the optimization of the technical architecture of the application
     Analyzes, design object, and definition of the technical specifications in UML
     Development java
    Context:
    The project rests on an architecture on 3 levels, of standard application Web/light customer based on the use
    of:
     Apache (Web server)
     Weblogic Server (waiter of application/middleware)
     DBMS Oracle (persistence of the data)
     CFT, ftp and MQSeries-JMS for the exchanges with IF partners
    The Apache waiter and the Weblogic field are lodged on the same physical machine, the Weblogic field
    being composed of two authorities:
     WLS-01 for the presentation layer
     A cluster WLS-02 and WLS-03 for the layer services trades
    The Oracle database is lodged on a separate machine. Base files them being stored on an external bay of discs.
    Functional axes of IF:
     The management of the producing contract
     Data processing of counting (control, correction, validation and calculation of energies)
     Publication of flows
     Invoicing of the components of the access to the public network of distribution and covering

    Environment: Java, SAP, Weblogic 10, PowerDesigner, Undertaken Achitect, Spring, Spring Batch, Ant, Linux

  • Function: Engineer of studies and development

    ACCENTURE - FRANCE Telecom-Orange Service-Paris Business of January
    2011 - Jan 2011

    Project:Data-processing direction - development of a gate Web of monitoring quasi real time of a network IP VPN
    (IP VPN Dashboard Monitoring) in Nimble mode
    Mission: Refer technical
     Analyzes, design in UML
     The selection of spots/modules has to deliver, at
    the beginning of each sprint
     Delivery of the selected modules has the end of
    each Sprint
     Immediate notification of problems, cut-off
    points to the scum-master degree
     Drafting of documentation
    Context: The purpose of this project of VPN monitoring, definite jointly with Siemens is to provide an instrument
    panel simplified to follow the good performance of the network. That would make it possible to go down in the
    entrails from the infrastructure network, and to collect information concerning the utilization ratio, and to analyze
    the elements of the topology of the network like following the gravity of the incidents

    Environment: Java, PowerDesigner, Spring, OSGI, Maven, Hibernate, GWT, Linux

  • Function: Engineer of studies and development

    T-SYSTEMS - PSA PEUGEOT CITROËN - Poissy
    Jan 2010 - Jan 2010

    Project: Data-processing direction - European Approval of cars
    Mission: Technical manager
     Participation in the installation of the technical architecture of the project in collaboration with
    teams Structures of the customer
     Participation in the installation of the data model and in its optimization (Oracle 10)
     Formation and framing of the development team and assignment of the spots
     Analyzes, design object, and definition of the technical specifications in UML
     Development of the batchs in Java (Spring Batch)
     The support of production of the applications, follow-ups of the deliveries
    Context:

    The project aims at the application and the generation of the CoC document.
    CoC is in application in Europe since 1996 for the particular vehicles.
    It is about a document referring certain features of the vehicle (dimensions, mass, CO2, etc.) + clean information
    (color, chassis number).
    This document is obligatory for the registration in certain countries (Germany, Italy, etc…). Optional in the other
    countries (the manufacturer must be able to produce it with the request when a vehicle registered in a country A
    must be transferred in a country B, in order to facilitate the administrative formalities in the country of destination).

    Environment: Java, SOA, Spring, Spring Batch, Hibernate, Maven, Oracle, Linux

  • _Engineer of studies and development

    T-SYSTEMS-MAPOWER DSI FRANCE
    Jan 2009 - Jan 2009

    Project: Direction of the information systems - the management of the industrial accidents
    Mission: Responsible for the design and development
     The definition of the technical specifications in UML
     Design object and development of the IHM, unit tests
     Technical receipt and support functional receipt
     Provision of the packages of deliveries
     The support of production of the applications, follow-ups of the deliveries

    Environment: JAVA /J2EE, XML, ECLIPSES, JavaScript
Études et formations

  • - Certificate Data Science (Machine learning, Spark, Hadoop, R,…) -

    Dauphine Paris University http:://www.certificat-data-science.dauphine.fr/
    2016

  • Vmware vSphere: Installation, Configuration and Administration v6 Global Knowledge

    2016

  • Project: Project of the Rhône-Alpes area to improve quality of the surface Mission: Development of a tool of forecast of the ozone peaks.  Application of a method of clustering based on fuzzy logic a

    - École Nationale Supérieure of Mine-St Etienne - Armines (Paris)
    2003

  • Computer engineer - Option “Information systems” - Constantine

    2000

  • DEA (Diploma of thorough studies - 3rd Cycle) MISI: “Computer Methods of the Industrial Systems” Option “Architectures with distributed objects”

    University of Versailles Saint Quentin - in Yvelines - PRISM Laboratory - Doctoral School SOFTWARE University of Electricity (SUPELEC) École Nationale Supérieure of the Mines of Paris
Autres compétences
TECHNICAL SKILLS

DevOps ANSIBLE, JENKINS, GIT, KUBERNATES, DOCKER
Big Data/BI: HADOOP YARN, PIG, HIVE, SQOOP, SPARK,
Programming: JAVA, R, SCALA, PYTHON, SQL, PASCAL, MATLAB, WINDEV
Methodology: AGILE SCRUM,
ERP: SAP PI, SAP POTAL, SAP HANA
DBMS: ORACLE, DB2, POSTGRESQL, MYSQL, ACCESS
Tools: RSTUDIO, HANA STUDIO, ECLIPSE, VISUAL STUDIO
PLM DELMIA, VPM, ENOVIA V6
Framework: SPRING, HIBERNATE, SAP WEBDYNPRO

D'autres freelances
Développeur JAVA

Ces profils pourraient vous intéresser !
CV Développeur Springboot
Pierre-Louis

Développeur Springboot

  • TARASCON
JAVA Spring Boot J2EE SQL Angular TypeScript JAVASCRIPT SCRUM STRIPE HUBSPOT
Disponible
CV Ingénieur de développement Spring Boot
Sylvain

Ingénieur de développement Spring Boot

  • JUMILHAC-LE-GRAND
Spring Boot BASH JAVA Angular TypeScript HIBERNATE DOCKER SQL
Disponible
CV Ingénieur de développement
Yacine Abdelhak

Ingénieur de développement

  • NANTERRE
JAVA Angular NODE.JS JAVASCRIPT DEVOPS
Disponible
CV Développeur Full Stack JAVA
Saad

Développeur Full Stack JAVA

  • FRANCONVILLE
JAVA J2EE SQL Angular PL SQL FLEX MAVEN SCRUM SPRING JAVASCRIPT
Disponible
CV Développeur JAVASCRIPT
Achref

Développeur JAVASCRIPT

  • PARIS
JAVASCRIPT JAVA Angular
Disponible
CV Développeur
Guilian

Développeur

  • ORSAY
TypeScript JAVASCRIPT PYTHON DOCKER LINUX LLM BASH SQL DEVOPS JAVA
Disponible
CV Technical Leader J2EE
Tariq

Technical Leader J2EE

  • NANTES
J2EE JAVA POSTGRESQL SQL Spring Boot HIBERNATE Angular Cloud AWS PL SQL CI/CD
Disponible
CV Développeur JAVA Neo4j
Sylvain

Développeur JAVA Neo4j

  • NOLAY
JAVA J2EE SQL Spring Boot JAVASCRIPT
Disponible
CV Développeur ANDROID
Marouane

Développeur ANDROID

  • MAISONS-ALFORT
ANDROID Kotlin JAVA C++ C#
Disponible
CV Ingénieur de développement JAVA
Hamza

Ingénieur de développement JAVA

  • BEZONS
JAVA
Disponible