PhaseIIIModelTraining2.docx

Phase III Model Training (Data File Phase 3 HTML)

Click on the HTML file attached to read the scenario. After reading through the case, please click next to jump into the quiz and exercises.

We recommend leaving the HTML file open so that it is easier for you to look for the information questioned in the quiz/exercise.

Q 1

Part 1.

What learning phenomena is the team observing now?

Convergence

Generalization

Overfitting

Underfitting

Part 2. (a)

What are some techniques that can be applied in order to improve generalization performance? Check all that apply.

Weight decay (L2 regularization)

Increasing the number of model parameters

Dropout

Stronger data augmentation

Early stopping

Part 2 (b)

Sometimes, overfitting is attributed to the task being “too hard.” Given what we know about model behavior during overfitting, how can this explanation be justified?

Part 3.

What is weight decay?

An added penalty in the loss function that encourages semantic clustering in feature space

An added penalty in the loss function that mitigates class imbalance

An added penalty in the loss function that ensures the model is well calibrated

An added penalty in the loss function that discourages models from becoming overly complex

Part 4.

What does dropout do?

Dropout randomly removes layers in the network during training in order to improve the rate of convergence

Dropout randomly removes neurons in the network during training in order to prevent overreliance on any one neuron

Dropout randomly removes layers in the network during training in order to prevent overreliance on any one layer

Dropout randomly removes neurons in the network during training in order to improve the rate of convergence

Part 5. Which of the following are tunable hyperparameters? Check all that apply.

Weight decay strength

Dropout probability

Learning rate

Model weights

Part 6.

The team is noticing counterintuitive results regarding the performance of the model when measured with accuracy and AUROC. What is likely occurring? NOTE: There are 27,000 COVID-negative exams and 3,000 COVID-positive exams, a breakdown of 90% negative cases and 10% positive cases.

Accuracy is a poor metric for performance because of the small number of samples in the test set

Accuracy is a poor metric for performance because of the high class imbalance

AUROC is a poor metric for performance because they have a predetermined threshold in mind

AUROC is a poor metric for performance because it can only be used in multi-class settings

Part 7.

Further analysis shows that the model is predicting that every patient is COVID-negative. What can be done to mitigate this effect? Check all that apply.

Using dropout during training to improve performance on the test set

Undersampling COVID-positive exams during training

Upweighting COVID-positive exams loss during training

Lowering the learning rate to improve convergence

Q 2

Part 1.

What is a pro of using k-fold cross-validation instead of a hold-out validation set for hyperparameter tuning?

Improves model convergence rates because many hyperparameters can be tested at the same time

Regularizes the model by randomly selecting training examples automatically

Requires less overall time to train a model, due to the reduced number of training samples

Produces a more reliable estimate of the generalization performance of the model

Part 2.

What is a con of using k-fold cross-validation instead of a hold-out validation set for hyperparameter tuning?

Increases the number of parameters in the overall model, which leads to overfitting

Decreases model generalization performance because the model is able to learn on the test set

Requires more overall time to train a model, due to the repeated training runs associated with each experiment

Increases the overall memory requirements of the model during training, due to the higher number of samples seen during training

Part 3.

What are common criteria used for early stopping? Check all that apply.

Training AUROC

Test loss

Training loss

Validation loss

Validation AUROC

Test AUROC

Part 4.

Which of the following hyperparameters are exclusive to deep learning models? Check all that apply.

Number of layers

Dropout probability

Weight decay strength

Learning rate

Class weights (loss function)

image3.wmf

image1.wmf

image2.wmf

Calculate the price of your order

550 words
We'll send you the first draft for approval by September 11, 2018 at 10:52 AM
Total price:
$26
The price is based on these factors:
Academic level
Number of pages
Urgency
Basic features
  • Free title page and bibliography
  • Unlimited revisions
  • Plagiarism-free guarantee
  • Money-back guarantee
  • 24/7 support
On-demand options
  • Writer’s samples
  • Part-by-part delivery
  • Overnight delivery
  • Copies of used sources
  • Expert Proofreading
Paper format
  • 275 words per page
  • 12 pt Arial/Times New Roman
  • Double line spacing
  • Any citation style (APA, MLA, Chicago/Turabian, Harvard)

Our guarantees

Delivering a high-quality product at a reasonable price is not enough anymore.
That’s why we have developed 5 beneficial guarantees that will make your experience with our service enjoyable, easy, and safe.

Money-back guarantee

You have to be 100% sure of the quality of your product to give a money-back guarantee. This describes us perfectly. Make sure that this guarantee is totally transparent.

Read more

Zero-plagiarism guarantee

Each paper is composed from scratch, according to your instructions. It is then checked by our plagiarism-detection software. There is no gap where plagiarism could squeeze in.

Read more

Free-revision policy

Thanks to our free revisions, there is no way for you to be unsatisfied. We will work on your paper until you are completely happy with the result.

Read more

Privacy policy

Your email is safe, as we store it according to international data protection rules. Your bank details are secure, as we use only reliable payment systems.

Read more

Fair-cooperation guarantee

By sending us your money, you buy the service we provide. Check out our terms and conditions if you prefer business talks to be laid out in official language.

Read more