Well, all a algebra is, is some algebra which is closed under countably infinite unions. In other words, the following is true:
This addition is all we lacked to start developing Probability Theory. Is this true for the intersections as well?
Please be aware that the algebra can contain a finite number of elements, or an uncountable infinite number of elements, as long as it's close under infinite unions we are gucci.
Also algebra IS an algebra, after all the condition is stronger. You can convince yourself that the converse is not true.
Subsets which belong to a algebra, here denoted are called measurable sets.
Countable vs Uncountable
Countable Sample Space
If our sample space is countable (finite or infinite), it is possible to define a algebra which simply consists of ALL possible subsets of (denoted ), and therefore we can assign a probability to each outcome in the sample space. In such cases we are operating in what's called a discrete probability space.
This is important, because in such spaces even though the algebra might be uncountably infinite (see Diagonalization Argument), it is straightforward to define a probability function such that and then assign to each event the probability of the sum of its elements. This is what we call a Discrete Probability Measure
Uncountable Sample Space
If the sample space is uncountably infinite, no such trick exist. That's when algebras really come into their own and Borel Sets really come into their own.