Create Spark Helm Chart

€30-250 EUR

In Bearbeitung

Veröffentlicht

vor etwa 4 Jahren

€30-250 EUR

Bezahlt bei Lieferung

Hi, what I need is the following: - I need a helm script (kubernetes) which "installs" the latest spark version as yarn cluster on kubernetes - This setup should provide Zeppelin - All of this has to work with sparks latest structured streaming framework and should be able subscribe a kafka topic - Confluent is used as kafka provider (and it's security mechanism - [login to view URL] = [login to view URL]) - Zeppelin has to deploy jobs to cluster and NOT execute them standalone - The kubernetes cluster doesn't use level 4 load balancer, so we can't simply use the following helm chart ([login to view URL]) - Kubernetes Level 7 Loadbalancers are used - Basic neccessary setup (Nodes needs to have the corresponding spark versions deployed) - Acceptance criteria: I have a structured streaming script, which we can use to check if setup works, in the meantime you can use your script for development. - Kubernetes Version is v1.16.3. - I can't grant you access to the cluster nor to the confluent stream. Thanks for your time.

Projekt-ID: 25391090

Über das Projekt

7 Vorschläge

Remote Projekt

Aktiv vor 4 Jahren

Möchten Sie etwas Geld verdienen?

E-Mail-Adresse

Vorteile einer Ausschreibung auf Freelancer

Legen Sie Ihr Budget und Ihren Zeitrahmen fest

Für Ihre Arbeit bezahlt werden

Skizzieren Sie Ihren Vorschlag

Sie können sich kostenlos anmelden und auf Aufträge bieten

Vergeben an:

@vivmistry

I am a DevOps Consultant & Certified Kubernetes Administrator with 13+ years of experience specializes in implementing and maintaining DevOps Tools using different tools like Jenkins, Docker, Kubernetes, Python, Groovy for both public & private cloud-hosted applications. and comfortable working with both Windows & Linux Operating Systems. In my latest project have setup DevOps, CI/CD Automation Framework for an Enterprise IT that supports 30+ applications and 100+ Automation Jobs. Given an opportunity, will be pleased to create the required Helm Chart. In case you need more information about me, please check my Linkedin Profile: [login to view URL]

€200 EUR in 7 Tagen

0,0

(0 Bewertungen)

0,0

7 Freelancer bieten im Durchschnitt €303 EUR für diesen Auftrag

@alonlong

● I have been in software development for 10+ years. ● I am a Golang developer with 5+ years of experience. ● I was responsible for many projects which is based on the microservice architecture and the design and development of service mesh. ● I am very familiar with the design of api gateway. ● I have developed many microservices which are based on grpc or http protocol. ● I am good at docker and kubernetes technology, and I have been responsible for company's containerization pre-research, solution design and practices. ● I use Git to manage project code and I like to research Golang open source code. ● I worked on the following technologies - Golang ,Websocket, gRPC, Docker, Kubernetes, Git ,GORM, Nginx, MongoDB, Kafka, PostgreSQL, MySQL and so on.

€500 EUR in 15 Tagen

5,0

(7 Bewertungen)

5,3

@usamaahmadkhan

Hi I am a DevOps Engineer with hands on experience in managing Kubernetes cluster. I understand your problem and can modify the helm chart as per your use case. I have also worked with Kafka in K8s and can modify it as per requirement. Let me know if you need my services. Thanks Usama

€280 EUR in 7 Tagen

5,0

(10 Bewertungen)

4,2

@iwanthereds

Hi there. Thank you for your posting. As a senior cloud developer, I am familiar with k8s and spark. I've been operating several k8s clusters (managed clusters, and on-premise clusters) for several years. Writing helm charts is the normal job for me, and so I am familair with helm template and jinja. Already, I wrote many helm charts to manage my clusters and apps on those clusters. Spark is also my job. Let's discuss the details. Regards.

€250 EUR in 7 Tagen

5,0

(5 Bewertungen)

2,7

@Ayouma

Hi, I'm a software engineer with 5 years of experience in Bigdata technologies (Kubernetes, Docker, Spark, Kafka, Scala, Python,..) in Paris on different activity areas like banking and energy :). For your project, I'm just worked on a similar project Kubernetes with the confluent operator. For more details feel free to send a msg :) Thanks in advance Ayoub

€500 EUR in 10 Tagen