Can I cancel a disability policy within in the first 2 years or so even though the policy is non-cancelable until age 65?

You always have the right to cancel a policy.  Of course, once you cancel it you will not be entitled to benefits should you otherwise qualify for benefits.  The term "non-cancelable" generally means that the insurance company cannot cancel the policy until a certain age.