Building a Self-Hosted RAG Chatbot From Scratch
How I built a production-grade, self-hosted RAG chatbot for my portfolio website - from GPU inference to OWASP security, running entirely on my own hardware.
Marcus Pichler
CTO THINKING. BUILDER MENTALITY.
From Edge to Cloud – I Build What's Next.
Technology leader with 25+ years of experience in enterprise IT, cloud platforms and IoT architecture. Building systems that connect hardware, software and people in a secure and scalable way.
Currently self-hosting LLMs on a K8s cluster with an RTX 3060. This chatbot? It runs on my hardware.
Key Strengths
Expertise built over two decades of hands-on experience
Cloud & IoT Architecture
AWS Certified Solutions Architect with deep expertise in designing secure, scalable cloud and IoT solutions from edge to cloud.
Platform Engineering
Building reliable infrastructure with Infrastructure as Code, CI/CD automation, and DevOps best practices.
Technical Leadership
Cross-functional team leadership with a focus on architecture clarity, solid execution, and team enablement.
Recent Experience
Building technology that delivers lasting results
Nov 2025 – Present
IT Architect
Land Salzburg, Austria
Delivering end-to-end IoT solutions – from device layer and network integration to cloud connectivity and business process embedding.
Oct 2022 – Oct 2025
IoT Solution Architect
PIERER Innovation, Salzburg
Orchestrated IoT project implementations for connected motorcycle platforms, including technical specifications and integration processes.
2001 – 2021
Various Senior Roles
SPAR ICS, Salzburg
20 years progressing from IT Support to Senior Product Lead, Enterprise Architect, and Innovation Lab Technical Lead.
Featured Projects
Solutions that have real-world impact
Connected Mobility
PIERER InnovationIntegrated Sibros' Deep Connected Platform into high-performance motorcycles, enabling OTA updates, remote diagnostics, and AAOS integration.
eSTORE Cash Register
SPAR ICSLinux-based POS solution with integrated DevOps practices for CI/CD, delivering secure and efficient operations across multiple regions.
Latest from the Blog
Thoughts on technology, architecture, and lessons learned
Welcome to My Blog
An introduction to my new blog where I'll share insights on cloud architecture, IoT, and technology leadership.