Osama bin Laden once crowed to an interviewer, Believe me, when your children and your wife become part of your struggle, life becomes very enjoyable. The late Al-Qaeda chief uttered those words before 9/11, when he was able to keep his four wives and many children living comfortably in separate houses across Afghanistan. But at the end, his rosy portrayal of being married to the Jihad was sorely tested. His family must have driven him nuts. During his last days in Abbottabad, bin Laden had to contend with three wives and 17 noisy children under one roof. He had no escape from the din, save for furtive pacing around the garden late at night or vanishing into his so-called Command-and-Control Centre, a dank, window-less room. Swathed against the Himalayan chill in a woollen shawl, he recorded rants that displayed an ever-widening disconnect with the daily grind of terrorism: his last oddball offerings were on climate change and capitalism. Bin Laden, the worlds most wanted terrorist, was also a family man. An Arab woman married to an al-Qaeda fighter told TIME that after 9/11, bin Laden and his lieutenants made provisions for their families to flee the impending NATO invasion of Afghanistan. His youngest wife, Amal, may have escaped to Yemen via Pakistan, while bin Ladens other wives are thought to have fled through Iran. But this terrorist got lonely. After setting up camp in Pakistan and breaking his own orders, he summoned back three wives: the most recent addition, Amal, plus two Saudi women hed wed in the 1980s. Both these Saudis were mature, educated women Khairiah a child psychologist and Siham a teacher of Arabic grammar. (They converted a room in the Abottabad mansion into a classroom.) Bin Laden had been their husband for 25 and 27 years, respectively. U.S. counter-terrorism experts, who are eager to interrogate the wives, now in Pakistani custody, will surely want to know how al-Qaeda smuggled the bosss wives and their kids up to Abbottabad to ease his solitude. Bid Laden married six times, but one marriage ended in divorce and the other was annulled. While in Afghanistan, the wives were able to steer clear of each other. According to a 2002 interview that AS, presumed to be Amal al-Sadah, gave to the magazine al Majalla, we did not live in one house. Each wife lived in her own house. There were two wives in Kandahar, each with her own house. The third wife had a house in Kabul, and the fourth in the Tora Bora mountains. Even then, a polygamous family is not without its frictions. When Amal joined the growing clan in 2000, bin Ladens other wives were upset, and even his mother chastised him, according to Lawrence Wright, journalist and author of The Looming Tower: al-Qaeda and the Road to 9/11. Judging from the blueprints of the Abbottabad house, bin Laden tried to keep his three families separate but equal. Each wife and her children were allotted their own floor, and bin Laden would spend time with each. When Navy Seals raided the compound, they found bin Laden on the third floor with Amal, the youngest. Initial White House accounts say she was shot in the leg while trying to shield her husband. In all, bin Laden had six wives. Wife #1: Najwa Ghamen, a Syrian and a first cousin, was 15 when she married bin Laden, scarcely two years older. Back then, bin Laden was a rich and well-connected Saudi youth, and Najwa had every reason to believe she was destined for a cushy life of luxury. Instead, she ended up raising 11 children on the run, struggling to keep her good looks in the scorching deserts of Afghanistan. (Bin Laden didnt believe in air conditioning or iced drinks, say his former comrades.) After 9/11, she fled Afghanistan with a mentally disabled son and is thought to have returned to her native Syria. Still married at the time of bin Ladens death, she is technically his fourth widow, although she is not in custody. (See The Real Housewife of Abbottabad: What bin Ladens Spouse Knows.) Wife #2: His second wife, Khadijah Sharif, was a teacher and nine years older than bin Laden when they were wed in 1983. She reportedly bore him three children before they were divorced sometime between 1993 and 1996 when they were living in Sudan, and bin Laden fell afoul of the Saudi regime. Wife # 3: His third wife, Khairiah, whom bin Laden wed in 1985, was the spiritual mother of the sprawling family, according to a woman who knew the bin Ladens in Afghanistan. She was very open-hearted. Everybody went to her for advice, she says. This source claims that after 9/11, Khairiah fled through Iran where she was detained under house arrest before the Iranians allowed her to return to Saudi Arabia. From there, she slipped back to Pakistan to rejoin the al-Qaeda chief in Abbottabad. Wife #4: Shiman Sabar, who was also captured in the Abbottabad house, wed bin Laden in 1987. Militant sources say that after 9/11 she may have slipped across into Pakistan and remained there in hiding until it was safe for her to answer her husbands summons. Wife #5: Bin Ladens fifth marriage is a mystery. The Saudi rashly wed a woman of unknown nationality in Khartoum in 1994 but the marriage was annulled before it was consummated within 48 hours. Wife #6: His last wife, Amal, may have been as young as 15 when a $5,000 bride price was paid to her Yemeni family and she was shipped off to marry bin Laden, nearly 30 years her elder, in Kandahar. Wed in 2000, they had one daughter, Safiya, who was allegedly in the bedroom with her father and mother when Seals shot him dead. So far, Pakistan has not charged his three widows of any crime. Pakistan has said it will expel the three back to Yemen and Saudi Arabia, but will grant direct access to US interrogators when the trio is ready. As for useful intelligence information, an Arab woman with ties to al-Qaeda, told Time that al-Qaeda militants arent big on pillow talk. They tend not to tell their wives anything about their operations, she says. Nevertheless, these three women all have vital stories to tell of how al-Qaedas network in Pakistan managed to smuggle them back to their forlorn terrorist husband and keep them hidden for so long. As widows, under Islam, they are free to marry again, if they wish. But few suitors are likely to step forward. Marrying the widow of the worlds most wanted man has its own complications. Tim McGirk, a former TIME bureau chief, is a fellow at the University of California at Berkeleys Investigative Reporting Program. Time