How to update Visual Studio Code on Ubuntu

Seeing the update notification on the bottom right when starting VS Code on Linux can be quite annoying, so this is how you can update your VS Code on Linux (I'm using Ubuntu).

If the application isn't already update, then restart Visual Studio Code and it will be on the latest version. Enjoy!

What's going on? I'm getting an error posting new posts.