The British-born crooner died at his home in Colorado, accoridng to the NY Daily News.
“It will be impossible to fill the space he leaves in our hearts,” his agent Barrie Marshall told the BBC.
Cocker rose to fame in 1964 and recorded 40 albums while touring into his 60s.
His cover of the Beatles' "With A Little Help from My Friends" vaulted to No. 1 and lifted Cocker to stardom. Cocker's "With A Little Help From My Friends" also was also the theme song for the wildly-popular television series "The Wonder Years."
He won a Grammy for "Up Where We Belong," a 1982 duet with Jennifer Warnes. Other Joe Cocker hits include "Feelin' Alright,""You Are So Beautiful" and "Unchain My Heart."
He was knighted by Queen Elizabeth in 2007 for his music achievements.