|Anthony Scaramucci was appointed on 21 July|
It said in a statement: "Mr Scaramucci felt it was best to give Chief of Staff John Kelly a clean slate and the ability to build his own team. We wish him all the best."
Mr Scaramucci, a wealthy New York financier, had been in his post for just 10 days.
His arrival in the West Wing on 21 July coincided with the resignation of press secretary Sean Spicer.
:: You're fired! Sackings and resignations in Donald Trump's White House
Donald Trump speaking at the White House on Monday
The New York Times said Mr Spicer had "vehemently disagreed" with the appointment of Mr Scaramucci, telling the President it was "a major mistake".
Later last week, chief of staff Reince Priebus was removed by President Trump.
Earlier today, Mr Trump tweeted there was "no "chaos" at the White House.
Mr Scaramucci caused an enormous commotion in Washington after giving an expletive-laden interview to The New Yorker magazine.