Decision Making On Noisy Data With Additional Knowledge