Do I have to be a Dux-Soup user in order to be Agency or Team plan admin?

You will need to download the free Dux-Soup extension, however, you do not need to activate paid features to access the admin panel. You can be a Dux-Soup account admin using a free Dux-Soup extension.