The Internet of Things (IoT) is an increasingly prominent aspect of our daily lives, with connected devices offering unprecedented convenience and efficiency. As we move towards a more interconnected world, ensuring the privacy and security of data generated by these devices is paramount. That is where decentralized federated learning comes in.

Federated Learning (FL) is a machine-learning paradigm that enables multiple parties to collaboratively train a model without sharing their data directly. This thesis focuses on taking FL one step further by removing the need for a central server, allowing IoT devices to directly collaborate in a peer-to-peer manner.

In this project, you will explore and develop decentralized federated learning frameworks specifically tailored for constrained IoT devices with limited computational power, memory, and energy resources. The aim is to design and implement efficient algorithms that can harness the collective power of these devices while ensuring data privacy and device autonomy. This involves tackling challenges related to resource-constrained environments, heterogeneous device capabilities, and maintaining security and privacy guarantees.

The project offers a unique opportunity to contribute to cutting-edge research with real-world impact. Successful outcomes will enable secure and private machine learning on IoT devices, fostering new applications in areas such as smart homes, industrial automation, and wearable health monitoring.

Responsibilities:

• Literature review on decentralized federated learning, especially in relation to IoT and decentralized systems.
• Design and development of decentralized FL frameworks suitable for constrained IoT devices.
• Implementation and evaluation of the proposed framework using real-world datasets and testbeds.
• Analysis of security and privacy aspects, along with resource utilization.
• Documentation and presentation of findings in a thesis report, possibly leading to publications in top venues.

Requirements:

• Enrollment in a Master's program in Computer Engineering, Computer Science, Electrical Engineering or related fields
• Solid understanding of machine learning algorithms and frameworks (e.g., TensorFlow, PyTorch)
• Proficiency in C and Python programming language
• Experience with IoT devices and embedded systems development
• Excellent analytical skills and a systematic problem-solving approach

Nice to Have:

• Knowledge of cybersecurity and privacy principles
• Familiarity with blockchain or other decentralized technologies
• Interest in distributed computing and edge computing paradigms

In the era of cloud-native computing, Kubernetes has emerged as a leading container orchestration platform, enabling seamless scalability and reliability for modern applications.

However, with its widespread adoption comes a new frontier in cybersecurity challenges, particularly low and slow attacks that exploit autoscaling features to disrupt services subtly yet effectively.

This project aims to delve into the intricacies of these attacks, examining their impact on Kubernetes' Horizontal Pod Autoscaler (HPA) and Vertical Pod Autoscaler (VPA), and proposing mitigation strategies for more resilient systems.

Responsibilities:

• Conduct a thorough literature review to identify existing knowledge gaps and research on similar attacks.
• Develop methodologies to simulate low and slow attack scenarios on Kubernetes clusters with varying configurations of autoscaling mechanisms.
• Analyze the impact of these attacks on resource utilization, service availability, and overall system performance.
• Evaluate current defense mechanisms and propose novel strategies to enhance the resilience of Kubernetes' autoscaling features.
• Implement and test selected mitigation approaches in a controlled environment.
• Document findings, present a comparative analysis of effectiveness, and discuss implications for future development in cloud security practices.

Requirements:

• A strong background in computer engineering, computer science or a related field.
• Familiarity with Kubernetes architecture and container orchestration concepts.
• Experience in deploying and managing applications on Kubernetes clusters.
• Proficiency in at least one scripting/programming language (e.g., Python, Go).
• Understanding of cloud computing and cybersecurity fundamentals.

Nice to Have:

• Prior research or hands-on experience in cloud security, particularly in the context of Kubernetes.
• Knowledge of network protocols and low-level system interactions.
• Experience with DevOps tools and practices.

We are seeking a highly motivated and skilled student to replicate a research paper that explores the application of pruning techniques for on-device training on microcontrollers. The original paper demonstrated the feasibility of deploying deep neural networks on resource-constrained devices, and achieved significant reductions in model size and computational requirements while maintaining acceptable accuracy.

Responsibilities:

• Extend our existing framework by implementing the pruning techniques on a microcontroller-based platform (e.g., Arduino, ESP32)
• Replicate the experiments described in the original paper to validate the results
• Evaluate the performance of the pruned models on various benchmark datasets
• Compare the results with the original paper and identify areas for improvement
• Document the replication process, results, and findings in a clear and concise manner

Requirements:

• Strong programming skills in C and Python
• Experience with deep learning frameworks (e.g., TensorFlow, PyTorch) and microcontroller-based platforms
• Familiarity with pruning techniques for neural networks is a plus
• Excellent analytical and problem-solving skills
• Ability to work independently and manage time effectively
• Strong communication and documentation skills

We are seeking an ambitious and forward-thinking working student to join our dynamic team working at the intersection of Machine Learning (ML) and Kubernetes. In this exciting role, you will be immersed in a cutting-edge environment where advanced ML models meet the power of container orchestration through Kubernetes. Your contributions will directly impact the development and optimization of scalable and robust ML serving systems leveraging the benefits of Kubernetes.

If you are a student passionate about both Machine Learning and Kubernetes, we invite you to join us on this exciting journey! We offer the chance to pioneer cutting-edge solutions that leverage the power of these two transformative technologies.

Responsibilities:

• Collaborate with a cross-functional team to design and implement ML workflows on Kubernetes.
• Assist in packaging and deploying ML models as microservices using containers (Docker) and managing them effectively through Kubernetes.
• Optimize resource allocation, scheduling, and scaling strategies for efficient model serving at varying workloads.
• Implement monitoring solutions specific to ML inference tasks within the Kubernetes cluster.
• Troubleshoot and debug issues related to containerized ML applications
• Document best practices, tutorials, and guides on leveraging Kubernetes for ML serving

Requirements:

• Currently enrolled in a Bachelor's or Master's program in School of CIT
• Strong programming skills in Python with experience in software development lifecycle methodologies.
• Familiarity with machine learning frameworks such as TensorFlow and PyTorch.
• Proficiency in container technologies. Docker and Kubernetes certification would be a plus but not mandatory.
• Experience with cloud computing platforms; e.g., AWS, GCP or Azure.
• Demonstrated ability to work independently with effective time management and strong problem-solving analytical skills.
• Excellent communication and teamwork capabilities.

Nice to Have:

• Kubernetes Certification: Having a valid Kubernetes certification (CKA, CKAD, or CKE) demonstrates your expertise in container orchestration and can be a significant advantage.
• Experience with DevOps and/or MLOps Tools: Familiarity with MLOps tools such as MLflow, Kubeflow, or TensorFlow Extended (TFX) can help you streamline the machine learning workflow and improve collaboration. Experience with OpenTelemetry, Jaeger, Istio, and monitoring tools is a plus.
• Knowledge of Distributed Systems: Understanding distributed systems architecture and design patterns can help you optimize the performance and scalability of your machine learning models.
• Contributions to Open-Source Projects: Having contributed to open-source projects related to Kubernetes, machine learning, or MLOps demonstrates your ability to collaborate with others and adapt to new technologies.
• Familiarity with Agile Methodologies: Knowledge of agile development methodologies such as Scrum or Kanban can help you work efficiently in a fast-paced environment and deliver results quickly.
• Cloud-Native Application Development: Experience with cloud-native application development using frameworks like Cloud Foundry or AWS Cloud Development Kit (CDK) can be beneficial in designing scalable and efficient machine learning workflows.

We are seeking a highly motivated and enthusiastic Working Student to join our team as part of the Edge AI Testbed project. As a Working Student, a key member of our research team, you will contribute to the development and testing of cutting-edge Artificial Intelligence (AI) systems at the edge of the network. You will work closely with our researchers and engineers to design, implement, and evaluate innovative AI solutions that can operate efficiently on resource-constrained edge devices.

Responsibilities:

• Assist in designing and implementing AI models for edge computing
• Develop and test software components for the Edge AI Testbed
• Collaborate with team members to integrate AI models with edge hardware platforms
• Participate in performance optimization and evaluation of AI systems on edge devices
• Contribute to the development of tools and scripts for automated testing and deployment
• Document and report on project progress, results, and findings

If you are a motivated and talented student looking to gain hands-on experience in Edge AI, we encourage you to apply for this exciting opportunity!

Requirements:

• Currently enrolled in a Bachelor's or Master's program in School of CIT
• Strong programming skills in languages such as Python and C++
• Experience with AI frameworks such as TensorFlow, PyTorch, or Keras
• Familiarity with edge computing platforms and devices (e.g., Raspberry Pi, NVIDIA Jetson)
• Basic knowledge of Linux operating systems and shell scripting
• Excellent problem-solving skills and ability to work independently
• Strong communication and teamwork skills

Nice to Have:

• Experience with containerization using Docker
• Familiarity with cloud computing platforms (e.g., Kubernetes)
• Experience with Apache Ray
• Knowledge of computer vision or natural language processing
• Participation in open-source projects or personal projects related to AI and edge computing

In the realm of AI applications, the deployment strategy significantly impacts performance metrics.

This research internship aims to investigate and benchmark AI applications in two predominant deployment configurations: monolithic and microservices-based, specifically within Kubernetes environments.

The central question revolves around understanding how these deployment strategies affect various performance metrics and determining the more efficient configuration. This inquiry is crucial as the deployment strategy plays a pivotal role in the operational efficiency of AI applications.

Currently, the field lacks a comprehensive benchmarking suite that evaluates AI applications from an end-to-end deployment perspective. Our approach includes the development of a benchmarking suite tailored for microservice-based AI applications.

This suite will capture metrics such as CPU/GPU/Memory utilization, interservice communication, end-to-end and per-service latency, and cache misses.

Voraussetzungen

Serverless computing is a cloud computing paradigm that separates infrastructure management from software development and deployment. It offers advantages such as low development overhead, fine-grained unmanaged autoscaling, and reduced customer billing. From the cloud provider's perspective, serverless reduces operational costs through multi-tenant resource multiplexing and infrastructure heterogeneity.

However, the serverless paradigm also comes with its challenges. First, a systematic methodology is needed to assess the performance of heterogeneous open-source serverless solutions. To our knowledge, existing surveys need a thorough comparison between these frameworks. Second, there are inherent challenges associated with the serverless architecture, specifically due to its short-lived and stateless nature.

 Requirements:

• Familiarity with Kubernetes
• Basics of computer networking