IAE Academy

GATE 2026 DA Q.29: solution and answer

GATE 2026 · DAQ.29 · 1 mark · NAT

Consider that for a supervised learning task, the objective function being minimized is , where is the input and is the parameter. Stochastic Gradient Descent with learning rate of 0.10 is used for parameter updates.

Suppose that at the end of iteration , the value of becomes 10.00.

Let be the input for iteration .

The value of at the end of iteration is __________. (Rounded off to two decimal places)

See the question in the paper

Answer and solution

ANSWER

The value of at the end of iteration is .

Official answer: 8.90 to 9.10Source: Official answer key, GATE 2026 DA (IIT Guwahati)

  1. The objective is , which is linear in the parameter . Stochastic gradient descent updates using the gradient of this objective with respect to for the current sample.

  2. Differentiate with respect to , treating as a constant: .

  3. At iteration the input is , so the gradient is . The value from the end of iteration does not enter the gradient, because the objective is linear in .

  4. SGD update rule: with and .

  5. Substitute: .

KEY IDEA

For a linear model the gradient with respect to is just the input . One SGD step is therefore .

WATCH OUT FOR

Differentiating with respect to instead of gives , i.e. , and a wrong update of for the wrong reason. Another slip is to multiply the learning rate by and get .

From the GATE 2026 DA paper. Every question of this paper · Download the full paper · All 4 Regression questions, with notes

More Regression questions