ELEC-E5510 - Speech Recognition D, Lecture, 26.10.2022-9.12.2022
This course space end date is set to 09.12.2022 Search Courses: ELEC-E5510
Lecture 3 NNLM exercise
Completion requirements
Make a submission
Opened: Wednesday, 9 November 2022, 9:30 AM
Due: Thursday, 10 November 2022, 11:55 PM
Exercise 1.
Assume that we have a simple neural network, which "knows" 100K words, and contains 2 hidden layers with 100 neurons. This network uses the one-hot
embedding to process words.
• Question 1. What percentage of the parameters are in the input and output layers?
• Question 2. If we want to cover 10 past words with this network how would the percentage change?
• Question 3. How would you change this model to reduce its size and increase its speed?