Sublime text 4 or 3

Do I need to download Sublime text 4 which is the latest instead of Sublime text 3 used in the course? Please clarify

yep
you are free to select any Advanced and modern IDE, its up to you.
You can try any IDE which can speedup and has better features i.e. VS Code or Sublime etc.