What is process for revoking driver’s license?

My doctor said that I was no longer to drive, but in fact my drivers license was still valid. What is the process for removing a senior’s drivers license if a doctor has concerns? How can a doctor’s opinion be challenged?

References

• CAA Seniors Driving Site
• CBC – For seniors, losing driver’s licence like having ‘arm cut off’