The baseline shiur for challah is five-fourths (five quarters) of a kav of flour, equivalent to forty-three and one-fifth eggs' worth, as stated in Mishnah Challah 1:1 and Mishnah Challah 2:6, and codified by Shulchan Arukh, Yoreh De'ah 324:1 and Arukh HaShulchan, Yoreh De'ah 324:15-16, with Kitzur Shulchan Arukh 35:2 and Sefer HaChinukh 385:1 giving the same measure in eggs and deriving it from the wilderness omer.
On the specific question of counting fermenting agents toward the shiur, Mishnah Challah 2:6 rules that when the sourdough starter (se'or) together with the bran makes up the five-fourths measure, the dough is obligated in challah, so a leaven component is counted together with the flour it came from — though bran that was removed and then returned is not counted, as explained by Arukh HaShulchan, Yoreh De'ah 324:15-16.
Sifrei Bamidbar 110:2 similarly ties the obligation to the dough reaching the five-fourths-and-more measure of flour at the point water is added and the dough is kneaded into a mass, tying the shiur to the flour content of the dough as a whole rather than treating any added substance separately.
Shulchan Arukh, Orach Chayim 456:1 describes the practical method of measuring the dough by filling a vessel with water, pouring it out, and filling the same vessel with forty-three and one-fifth eggs' worth of flour to establish the measure, giving a working procedure for determining when the shiur has been reached.
Avnei Yashfeh 6:134 states that the shiur for challah is measured by the amount of flour alone, without adding in the water, meaning no obligation arises until the flour itself in the dough reaches the requisite amount — a ruling directly relevant to how a sourdough starter, which itself consists of flour and water, should be weighed.
Rav Mordechai Eliyahu (Maamar Mordechai Hilchot Shabbat, Chelek 1 1:58) gives the practical modern weights, ruling that a dough made from flour alone (without additions) weighing up to 1,666 grams requires no separation at all, between 1,666 and 2,486 grams one separates without a brachah out of doubt, and from 2,486 grams and up one separates with a brachah — a ruling framed specifically around the weight of flour in the dough.
Other Mishnaic sources address related but distinct scenarios: Mishnah Challah 1:7 discusses a baker who prepares se'or for distribution or dough on behalf of several women, where the shiur is assessed per batch, and Zevachim 78a and Pesachim 48a together with Pesachim 48b discuss the shiur of dough as it bears on mixtures of grains and the kav of Melogna used for both Pesach dough and challah, showing the shiur's consistency across these contexts.
Mishneh Torah, Forbidden Foods 15:13 addresses the separate issue of a batel b'shishim-type calculation for challah that became mixed into non-designated flour, a related but distinct question of measurement by ratio rather than the basic shiur itself.
Sefer HaChinukh 385:2 and HaKtav VeHaKabalah, Bamidbar 15:20 add that outside the land the obligation to separate challah is rabbinic, so as not to let the halacha be forgotten, and that the biblical shiur for the dough itself parallels the wilderness omer-measure, framing why the same flour-based shiur persists even where the separation itself is only kazayit and discarded.
Revavos Ephraim (Revavos Ephraim 4:211) addresses a related practical question of who may serve as the agent performing hafrashat challah, discussing whether a minor can do so.
B'tzel HaChochma (בצל החכמה ח"ג סי' ע"ג) addresses when the brachah for hafrashat challah should be recited, generally favoring reciting it before separating the dough, while permitting one who first sets aside a piece without yet intending it as challah to recite the brachah afterward.
Shevet HaLevi (שבט הלוי ח"ד סי' קמ"ו) addresses the timing of the brachah relative to the act of separation and naming the challah, discussing disputes about when the separation itself generates kedushah and touching on related cases involving dough intended for other uses.