Write a short essay on the challenges of learning from high-dimensional and low-sample data and
conclude that these are the challenges which you are going to address in your project. To give you some
insights, these challenges may include:
1)Generalization problem – why high-dimensional models generalize well?
2)Stability problem – why existing deep learning models may be unstable (see adversarial examples)? How to
fix this?
3)Maintenance problem – how to maintain high-dimensional AI systems without re-training? This may touch
upon online learning and learning without catastrophic forgetting
4)How to conceptualize from existing knowledge? the problem of AI being able to learn from texts and books
(this is related to 3 and 1 but not necessarily the same)
Sample Solution