Skip to main content

Newton–Raphson - Failure of the method to converge - example

The method does not converge , it means the approximation could not found

for certain equations like for ex 


y = 2 * x +2 * z +1 - b

here b is the value we need to find 

2 * x +2 * z +1 =  b


if we try the iteration method for this to find the value of x where the loss is zero

the cycle tends to repeat the same value for x alternatively .


finding dy/dx = 2 ,dy/dz =2 

x1 = x 0 - y(x0, z0)/ f '(x)

z1 = z 0 - y(x0, z0)/ f '(z) 

assume values for x0 = 0.5 , z0 = 0.4 , b = 24

y(0) = 2 *(0.5) +2 *(0.4) +1 - 24

 y0=-21.2


x1 = 0.5 - (-21.2 /2)

x1 = 11.1

z1 = 0.4 -  (-21.2 /2)

 z1 = 11


to check for convergence i wil substitute the value of x1 and z1 in the equation 

so that if it converges ,means  y =0 ,because iam expecting a value of 24 from the 

equation, lets see


y1 = 2(0.5) +2(11) +1 -24

y1= 21.2 


the loss here is too large not even close to zero.

ok we wil go for the next iteration and see

x2 = x1 - y1/f '(x1)

z2 = z1 - y1/f '(z1)

x2 = 11.1 - (21.2/2)

x2= 0.5

z2 = 11 - (21.2 /2)

z2 = 0.4

 

so whats this it looks like we have moved back to our initial guessed values for x ,z  

so the newton's method rotates and will not converge for this equation.

the reason why this is not used for machine learning convergence.


 

 

Comments

Popular posts from this blog

Node and Auth0 - Integration

 so now we have completed all the steps for integration  since we have the node and auth0 as two separate things the integration happens in the app.js  we need to modify the app.js with some auth0 code  app.js / const http = require('http'); const express = require('express'); var router = require('express').Router(); const { auth } = require('express-openid-connect'); const app = express(); app.use('/', router); const hostname = '127.0.0.1'; const port = 3000; http.createServer(app)   .listen(port, () => {     console.log(`Listening on `);   }); const config = {   authRequired: false,   auth0Logout: true,   secret: 'a long, randomly-generated string stored in env',   baseURL: 'http://localhost:3000',   clientID: 'QxpAXsXkzy0Vm2VdT6dFFS0VOKdrah67',   issuerBaseURL: 'https://dev-bnga041p.us.auth0.com' }; console.log(config) // auth router attaches /login, /logout, and /callback routes to the baseURL app.u

Auth0

You might be wondering what is this auth0  it is used for authentication of you applications  could be any apps  1.SPA - Angular , React  2.web app 3.Node  here we will talk about the node use case and go with example  moving ahead for now  if your are not familiar with node dont worry its a funny exercise for now walk with me  we dont have to worry too much for authentication as the service is  provided from auth0   create your node app  install node  https://nodejs.org/en/download/package-manager/  choose your os and do the installation once installed check for the version ' node -v  ' i assume u have installed so that u wil get the version for now  since iam using LINUX this will look like root@strings-desktop:/home/strings/js# node -v v16.13.0 moving on to creating node app for now    create a file app.js and paste the contents  app.js/ const http = require('http'); const express = require('express'); const app = express(); const hostname = '127.0.0.1&#