Allowing CP (8090) only for some users

Allowing CP (8090) only for some users…
Is there a way?

I use CSF,

I have 8090 open
I have my static IP and one other collegue’s static IP in allow lists.

But as far as I know these are not related. I mean I cannot open 8090 for only these IP’s. Am I wrong?

In cPanel this was controlled by Host Access Control tab, where I enable some services (WHM, cPanel, FTP etc) to these fixed IP’s and reject all others. This was rejecting many hack attempts.

Can I have similar functionality?

BTW, I’m on CentOS 7.x