- Unable to fetch resource from https://tumanager.ei.tum.de/service.php?mode=open&token=lifecycle_sec_tueilnt&advisor=ge45cox with exception
- cURL error 28: Failed to connect to tumanager.ei.tum.de port 443 after 10001 ms: Timeout was reached (see https://curl.se/libcurl/c/libcurl-errors.html) for https://tumanager.ei.tum.de/service.php?mode=open&token=lifecycle_sec_tueilnt&advisor=ge45cox
NN/LLM quantization optimization
Neural Networks (NNs), Large Language Models (LLMs), Quantization, Optimization
Description
With the rise of Large Language Models (LLMs) and Vision Transformers (ViTs), we investigate the return from expensive "Quantization-Aware Training" (QAT), towards smarter "Post-Training Quantization" (PTQ), where the choice of "what" to quantize and "how" is guided by (sometimes) sophisticated metrics. The student is expected to perform an evaluation of such metrics and their effect to the quantization results.
Prerequisites
Linear algebra (good to have)
Python coding skills (must)
Neural network basics (must)
Contact
If you are interested, please contact us by email and we can discuss more information and details. Also contact us if you have your own ideas that you would like to explore!