Aether - Lead Data Experience

General Information

• Duration: 6 months at 2 days a week
• Team Size: 68 members total
• Year: Third year at Epitech
• Objective: Develop a search engine
• Languages / Technologies: Data Architecture, Cassandra, Kafka, Python

Introduction

I'm excited to share my experience as a lead data on an engaging project: the creation of a search engine. In this article, I'll give you an overview of my role, the challenges we faced and the lessons I learned along the way.

Project Background

Our goal was to develop a high-performance search engine capable of processing and indexing large quantities of data. The project is spread over several months, with intensive work sessions on Thursdays and Fridays. As Lead Data, I manage a team of six people and am responsible for coordinating our efforts and the overall progress of the project.