first go to your WHM, then find edit DNS
edit your domain
then add it. example ns1.domain.com and ns2.domain.com
then add
ns1 A yourIP
ns2 A yourIP
after that save it.
Then go to your domain manager, add it in child nameserver, after that you can use your own custom name server