Hey information theorists/terrorists: what is a good way to measure information in a multivariate setting? I can compute the per-variable and joint Shannon entropy just fine, but would like something that priorities a big per-variable decrease over a slightly higher joint decrease. (It’s better if I can determine two variables completely instead of something complex […]

Read More… from