Skip to content
View sojaeheon's full-sized avatar
11 followers · 19 following
  • SSAFY
  • Korea

Achievements

Achievement: Pull Sharkx2Achievement: YOLOAchievement: Quickdraw

Achievements

Achievement: Pull Sharkx2Achievement: YOLOAchievement: Quickdraw

Organizations

@Attack-on-no-5 @jo3mosa @travelLens @HokklakManagement

Block or report sojaeheon

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please donโ€™t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this userโ€™s behavior. Learn more about reporting abuse.

Report abuse
sojaeheon/README.md

Data Engineering ยท Data Infrastructure

์„œ๋น„์Šค์—์„œ ๋ฐœ์ƒํ•œ ๋ฐ์ดํ„ฐ๊ฐ€ ์ˆ˜์ง‘ยท์ฒ˜๋ฆฌยท์ €์žฅยท๊ฒ€์ƒ‰ยทํ™œ์šฉ์œผ๋กœ ์ด์–ด์ง€๋Š” ํ๋ฆ„์„ ์„ค๊ณ„ํ•ฉ๋‹ˆ๋‹ค.
๋ฐฐ์น˜์™€ ์ŠคํŠธ๋ฆฌ๋ฐ ํŒŒ์ดํ”„๋ผ์ธ์„ ๊ตฌ์ถ•ํ•˜๊ณ , ์•ˆ์ •์ ์ธ ์šด์˜์„ ์œ„ํ•œ ์ธํ”„๋ผ๊นŒ์ง€ ํ•จ๊ป˜ ๊ณ ๋ฏผํ•ฉ๋‹ˆ๋‹ค.


๐Ÿ‘‹ About Me

๋ฐ์ดํ„ฐ ํŒŒ์ดํ”„๋ผ์ธ ๊ตฌ์ถ•์„ ์ค‘์‹ฌ์œผ๋กœ, ๋ฐ์ดํ„ฐ๊ฐ€ ์ˆ˜์ง‘ยท์ฒ˜๋ฆฌยท์ €์žฅ๋˜์–ด
์„œ๋น„์Šค์™€ ๋ถ„์„์— ํ™œ์šฉ๋˜๋Š” ๊ณผ์ •์„ ํ”„๋กœ์ ํŠธ๋ฅผ ํ†ตํ•ด ๊ฒฝํ—˜ํ–ˆ์Šต๋‹ˆ๋‹ค.

Kafka, Airflow, Spark๋ฅผ ํ™œ์šฉํ•œ ์‹ค์‹œ๊ฐ„ยท๋ฐฐ์น˜ ๋ฐ์ดํ„ฐ ์ฒ˜๋ฆฌ์™€
Docker, AWS ๊ธฐ๋ฐ˜ ์‹คํ–‰ยท๋ฐฐํฌ ํ™˜๊ฒฝ์„ ๋‹ค๋ค„์™”์Šต๋‹ˆ๋‹ค.

ํ˜„์žฌ๋Š” ๋ฐ์ดํ„ฐ ์ •ํ•ฉ์„ฑ, ์žฌ์ฒ˜๋ฆฌ, ๋ชจ๋‹ˆํ„ฐ๋ง ๋“ฑ
์•ˆ์ •์ ์ธ ๋ฐ์ดํ„ฐ ํŒŒ์ดํ”„๋ผ์ธ ์šด์˜์— ํ•„์š”ํ•œ ์—ญ๋Ÿ‰์„ ํ•™์Šตํ•˜๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค.

๋ฐฑ์—”๋“œ์™€ ์ธํ”„๋ผ ๊ฒฝํ—˜์„ ๋ฐ”ํƒ•์œผ๋กœ
์„œ๋น„์Šค์™€ ๋ฐ์ดํ„ฐ ์‹œ์Šคํ…œ์˜ ์—ฐ๊ฒฐ์„ ์ดํ•ดํ•˜๋Š” ๋ฐ์ดํ„ฐ ์—”์ง€๋‹ˆ์–ด๋ฅผ ์ง€ํ–ฅํ•ฉ๋‹ˆ๋‹ค.


๐Ÿ”ง What I Do

  • Kafka ๊ธฐ๋ฐ˜ ์‹ค์‹œ๊ฐ„ ์ด๋ฒคํŠธ ์ˆ˜์ง‘ ๋ฐ ์ฒ˜๋ฆฌ
  • Airflow ๊ธฐ๋ฐ˜ ๋ฐฐ์น˜ ํŒŒ์ดํ”„๋ผ์ธ ๊ตฌํ˜„
  • SparkยทHadoop ๊ธฐ๋ฐ˜ ๋ถ„์‚ฐ ๋ฐ์ดํ„ฐ ์ฒ˜๋ฆฌ
  • ๊ด€๊ณ„ํ˜• ๋ฐ์ดํ„ฐ๋ฒ ์ด์Šค ๋ชจ๋ธ๋ง ๋ฐ ์ ์žฌ
  • Elasticsearch ๊ธฐ๋ฐ˜ ๊ฒ€์ƒ‰ ๋ฐ์ดํ„ฐ ๊ตฌ์„ฑ
  • DockerยทAWS ๊ธฐ๋ฐ˜ ์‹คํ–‰ ๋ฐ ๋ฐฐํฌ ํ™˜๊ฒฝ ๊ตฌ์„ฑ

๐Ÿค How I Work

  • ๊ตฌํ˜„ ์ „ ๋ฐ์ดํ„ฐ ํ๋ฆ„๊ณผ ์š”๊ตฌ์‚ฌํ•ญ์„ ์ •๋ฆฌํ•ฉ๋‹ˆ๋‹ค.
  • ์„ค๊ณ„์„œ์™€ API ๋ช…์„ธ๋ฅผ ๊ธฐ์ค€์œผ๋กœ ๊ตฌํ˜„ ๋ฐฉํ–ฅ์„ ๋งž์ถฅ๋‹ˆ๋‹ค.
  • ๋ฐ์ดํ„ฐ์˜ ์ž…๋ ฅยท์ฒ˜๋ฆฌยท์ €์žฅ ๊ณผ์ •์„ ๋‹จ๊ณ„๋ณ„๋กœ ํ™•์ธํ•ฉ๋‹ˆ๋‹ค.
  • ๊ตฌํ˜„ ๋‚ด์šฉ๊ณผ ๋ฐœ์ƒํ•œ ์ด์Šˆ๋ฅผ ๊ธฐ๋กํ•˜๊ณ  ๊ณต์œ ํ•ฉ๋‹ˆ๋‹ค.
  • ํ•ต์‹ฌ ๊ธฐ๋Šฅ์„ ๋จผ์ € ๊ตฌํ˜„ํ•˜๊ณ  ์ ์ง„์ ์œผ๋กœ ๊ฐœ์„ ํ•ฉ๋‹ˆ๋‹ค.
  • ์˜ˆ์™ธ ์ƒํ™ฉ๊ณผ ๋ฐ์ดํ„ฐ ์ •ํ•ฉ์„ฑ์„ ํ•จ๊ป˜ ํ™•์ธํ•ฉ๋‹ˆ๋‹ค.

๐ŸŽฏ Current Focus

  • ์‹ค์‹œ๊ฐ„ยท๋ฐฐ์น˜ ๋ฐ์ดํ„ฐ ํŒŒ์ดํ”„๋ผ์ธ ์šด์˜๊ณผ ๋ชจ๋‹ˆํ„ฐ๋ง
  • ๋ฐ์ดํ„ฐ ์ •ํ•ฉ์„ฑยทํ’ˆ์งˆยท์žฌ์ฒ˜๋ฆฌ ๊ตฌ์กฐ ํ•™์Šต
  • KafkaยทSpark ๊ธฐ๋ฐ˜ ์ŠคํŠธ๋ฆฌ๋ฐ ๋ฐ์ดํ„ฐ ์ฒ˜๋ฆฌ
  • Kubernetes ๊ธฐ๋ฐ˜ ๋ฐ์ดํ„ฐ ์‹œ์Šคํ…œ ์šด์˜ ํ•™์Šต
  • ์Šค๋งˆํŠธํŒฉํ† ๋ฆฌ ๋ฐ์ดํ„ฐ ํ”Œ๋žซํผ๊ณผ ์ฒ˜๋ฆฌ ๊ตฌ์กฐ

๐ŸŽ“ Education

Mar. 2019 โ€“ Feb. 2025 Kunsan National University
B.S. in Embedded Software ยท Double Major in Software
Jul. 2025 โ€“ Jun. 2026 Samsung Software Academy for Youth (SSAFY)
Data Track ยท Data Analysis ยท Algorithms ยท AI

๐ŸŒฑ University Activities

Mar. 2023 โ€“ Dec. 2023 SW์ค‘์‹ฌ๋Œ€ํ•™์‚ฌ์—…๋‹จ SW๋ด‰์‚ฌ๋‹จ
๊ณ ๋“ฑํ•™์ƒ์„ ๋Œ€์ƒ์œผ๋กœ ์†Œํ”„ํŠธ์›จ์–ด ๊ต์œก ๋ถ€์Šค ์šด์˜
Mar. 2024 โ€“ Nov. 2024 AIM ๋™์•„๋ฆฌ
RAG ๊ธฐ๋ฐ˜ ๋†์—… ์ •๋ณด ์ œ๊ณต ์„œ๋น„์Šค๋ฅผ ์ฃผ์ œ๋กœ ์•„์ด๋””์–ด ๊ณต๋ชจ์ „์— ์ฐธ์—ฌ

๐Ÿ† Awards

2026 SSAFY Special Project Excellence Award
2nd Place ยท ๋”ธ๊น ๋น„์ฆˆ๋‹ˆ์Šค
2024 SW-Centered University Outstanding Project Competition
Encouragement Award

๐Ÿ“„ Papers

Aug. 2024 ํšจ์œจ์ ์ธ ์ฃผ์ฐจ ํ™˜๊ฒฝ์„ ์œ„ํ•œ ์ž…์ถœ์ฐจ ๋ฐ์ดํ„ฐ ๊ธฐ๋ฐ˜ ์ฃผ์ฐจ ๊ณต๊ฐ„ ํŒŒ์•… ์‹œ์Šคํ…œ
์ž…์ถœ์ฐจ ๋ฐ์ดํ„ฐ๋ฅผ ํ™œ์šฉํ•œ ์ฃผ์ฐจ ๊ณต๊ฐ„ ์ƒํƒœ ํŒŒ์•… ์‹œ์Šคํ…œ ์„ค๊ณ„ ๋ฐ ๋…ผ๋ฌธ ์ž‘์„ฑ
๐Ÿ“„ View Publication โ†—
Jun. 2023 ChatGPT๋ฅผ ํ™œ์šฉํ•œ ์˜๋† ํ™œ๋™ ์ง€์› ์‹œ์Šคํ…œ
์˜๋† ํ™œ๋™ ์ง€์›์„ ์œ„ํ•œ ChatGPT ๊ธฐ๋ฐ˜ ์„œ๋น„์Šค ์„ค๊ณ„ ๋ฐ ํ•™์ˆ ๋Œ€ํšŒ ๋…ผ๋ฌธ ์ž‘์„ฑ
๐Ÿ“„ View Publication โ†—

๐Ÿ› ๏ธ Tech Stack

Backend
Data Engineering
Data Analysis
Database & Search
AI & LLM
Cloud & Infra
Frontend
Collaboration

๐Ÿ“‚ Projects

Project Introduction
MODU ์‹œ์žฅ ๋ฐ์ดํ„ฐยท๋‰ด์Šคยท๊ธฐ์ˆ ์ง€ํ‘œ๋ฅผ ๋ถ„์„ํ•ด ํˆฌ์ž ํŒ๋‹จ๊ณผ ๋ฉ€ํ‹ฐ ์—์ด์ „ํŠธ ๊ธฐ๋ฐ˜ AI ์ž๋™๋งค๋งค ์ง€์›ํ•˜๋Š” ํ”Œ๋žซํผ
๋”ธ๊น ๋น„์ฆˆ๋‹ˆ์Šค ๊ฐ€์ƒ ๊ธฐ์—…์„ ์šด์˜ํ•˜๋ฉฐ ์‚ฐ์—… ๊ฐ„ ์ˆ˜์š”ยท๊ณต๊ธ‰๊ณผ ๊ฒฝ์ œ ํ๋ฆ„์„ ์ฒดํ—˜ํ•˜๋Š” ์‹ค์‹œ๊ฐ„ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ๊ฒŒ์ž„
LOOKie ์ž‘์—… ํ˜„ํ™ฉ์„ ํ†ตํ•ฉํ•˜๊ณ  WebRTC ์†Œํ†ต๊ณผ AI ์žฌ๋ฐฐ์น˜๋กœ ํ˜„์žฅ ์šด์˜์„ ์ง€์›ํ•˜๋Š” ๋ฌผ๋ฅ˜ ๊ด€๋ฆฌ ํ”Œ๋žซํผ
TravelLens ์—ฌํ–‰์ง€์˜ ์ธ๊ธฐยท์œ„ํ—˜๋„์™€ ๋‹ค์–‘ํ•œ ์—ฌํ–‰ ์ •๋ณด๋ฅผ ํ†ตํ•ฉํ•ด ์‚ฌ์šฉ์ž์˜ ์—ฌํ–‰์ง€ ํƒ์ƒ‰์„ ๋•๋Š” ์ •๋ณด ์ œ๊ณต ํ”Œ๋žซํผ
Farmi ๋ณ‘ํ•ด ์ง„๋‹จ๊ณผ ํ™˜๊ฒฝ ๋ชจ๋‹ˆํ„ฐ๋ง, ์›๊ฒฉ ์ œ์–ด๋ฅผ ํ†ตํ•ฉํ•œ ์ดˆ๋ณด ๋†๋ฏผ์„ ์œ„ํ•œ ์Šค๋งˆํŠธํŒœ ๊ด€๋ฆฌ ๋ฐ ์ •๋ณด ๋ฐ ์ œ๊ณต ํ”Œ๋žซํผ

๐Ÿ“š Continuous Learning

Data Architecture ๋ชจ๋ฅด๋ฉด ์Šน์ง„ ์•ˆ๋˜๋Š” ๋ฐ์ดํ„ฐ ์•„ํ‚คํ…์ฒ˜์˜ ์ •์„
์‹ ๋ขฐ์„ฑยทํ™•์žฅ์„ฑยท์œ ์ง€๋ณด์ˆ˜์„ฑ ๋“ฑ ๋ฐ์ดํ„ฐ ์‹œ์Šคํ…œ ์„ค๊ณ„ ๊ฐœ๋…์„ ํ•™์Šตํ•˜๊ณ , ์ง์ ‘ ์ž‘์„ฑํ•œ ์„ค๋ช…๊ณผ ๋‹ค์ด์–ด๊ทธ๋žจ์œผ๋กœ ์ •๋ฆฌํ•˜๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค.
๐Ÿ“ Repository: DataArchitecture_Study โ†—
Data Engineering Kafka & Spark๋ฅผ ํ™œ์šฉํ•œ Realtime Data Lake
Kafka ๊ธฐ๋ฐ˜ ๋ฐ์ดํ„ฐ ์ˆ˜์ง‘๊ณผ Spark ์ŠคํŠธ๋ฆฌ๋ฐ ์ฒ˜๋ฆฌ, ๋ฐ์ดํ„ฐ ๋ ˆ์ดํฌ ๊ตฌ์ถ• ๊ณผ์ •์„ ์‹ค์Šตํ•˜๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค.
๐Ÿ“ Repositories: kafka_spark_study โ†— ย ยทย  kafka-producer โ†— ย ยทย  kafka-consumer โ†— ย ยทย  pyspark-apps โ†—
Infrastructure EKS๋ฅผ ํ™œ์šฉํ•œ Spring ์šด์˜ ์„œ๋ฒ„ ๋ฐฐํฌ
DockerยทKubernetesยทAWS EKS๋ฅผ ํ™œ์šฉํ•œ ์• ํ”Œ๋ฆฌ์ผ€์ด์…˜ ๋ฐฐํฌ์™€ ์šด์˜ ํ™˜๊ฒฝ ๊ตฌ์„ฑ์„ ์‹ค์Šตํ•˜๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค.

๐Ÿ“ซ Contact

Pinned Loading

  1. smartfarm smartfarm Public

    ๋ณ‘ํ•ด ์ง„๋‹จ ๋ฐ ์ฑ—๋ด‡ ์„œ๋น„์Šค(Farmi)

    Vue 1 3

  2. jo3mosa/modu jo3mosa/modu Public

    AI Agent ๊ธฐ๋ฐ˜ ์ฃผ์‹ ํŠธ๋ ˆ์ด๋”ฉ ์˜์‚ฌ๊ฒฐ์ • ์ง€์› ์„œ๋น„์Šค

    Java 2

  3. click_business click_business Public

    ๊ฒฝ์ œ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ๊ฒŒ์ž„(๋”ธ๊น ๋น„์ฆˆ๋‹ˆ์Šค)

    TypeScript 1

  4. LOOKie LOOKie Public

    Forked from ydh0318/LOOKie

    AI ๊ธฐ๋ฐ˜ ๋ฌผ๋ฅ˜ ์ง‘ํ’ˆ ํ˜„์žฅ ๊ด€์ œ ์‹œ์Šคํ…œ

    Java 1

  5. travelLens/travel_lens travelLens/travel_lens Public

    ์—ฌํ–‰ ๋ฐ์ดํ„ฐ ๊ธฐ๋ฐ˜ ์ธ์‚ฌ์ดํŠธ ํ”Œ๋žซํผ(ํŠธ๋ž˜๋ธ”๋žœ์ฆˆ)

    Python 1

  6. Algorithm Algorithm Public

    ์•Œ๊ณ ๋ฆฌ์ฆ˜ ์ •๋ฆฌ

    Python 1