The Iraqi Shuk is the best place to buy fresh vegetables and fruits in the Machane Yehuda Market. Their products are good and usually cheaper than products on the main streets of Machane Yehuda. Plus, it's size and and form makes for a more intimate shopping.
It's parallel to the main open street and it'd be easier to just ask around.
Mahane Yehuda Market, Jerusalem