My Projects

Key Contributions:

• One of the main developers of ServerlessLLM, an open-source serving system designed for affordable multi-LLM deployment, optimizing for environments with limited GPU resources
• Implemented a distributed profiling component for ray workers
• Built and containerized the project using Docker to simplify deployment processes across various platforms
• Improved the auto-scaling component, enabling elastic scaling of model instances and efficient GPU multiplexing
• Developed a command-line interface and comprehensive tests to ensure reliability and ease of use

Technologies Used:

Key Contributions:

• Developed a state-of-the-art Speech Emotion Recognition (SER) system by transitioning from traditional ML methods to fine-tuning self-supervised models
• Fine-tuned the cross-lingually pre-trained model to achieve SOTA performance
• Implemented extensive data augmentation and hyperparameter optimization techniques to enhance model robustness and generalization

Technologies Used:

Key Contributions:

• Engineered a C-based simulator that merges cache systems with virtual memory management, featuring TLB and Page Tables, to accurately simulate address translation from virtual to physical
• Introduced adjustable settings for cache sizes, TLB entries, and page replacement methods, offering the ability to mimic different computing environments. This adaptability is key for analyzing how system performance varies with configuration changes
• Established comprehensive error handling to detect, report, and resolve simulation issues, ensuring the simulator's reliability and producing precise outcomes while enhancing the user experience by minimizing disruptions

Technologies Used: