Octopus is continuous deployment tool, while jenkins is general-purpose CI/CD platform, normally Octopus is used after (integrated with) Jenkins.

Normally octopus is compared with Harness and Spinnaker

Which one is better always depends on your use case? try one and use another tool to compare, you will get it by yourself.