I'm seeing that ColumnHeaderContainerStyle property is not being applied to the generated header controls, and also our default template for the GridViewColumnHeader is not binding to the control properties like Background, so changes there will not reflect in the header representation.
Could you please report it in our bugtracker, we will fix it as soon as we can.
In the meantime you can redefine the default style and template in your xaml:
<Grid
xmlns="http://schemas.microsoft.com/winfx/2006/xaml/presentation"
xmlns:x="http://schemas.microsoft.com/winfx/2006/xaml">
<Grid.Resources>
<ControlTemplate x:Key="GridViewHeaderTemplate" TargetType="GridViewColumnHeader">
<Border Background="Black">
<ContentPresenter VerticalAlignment="{TemplateBinding VerticalContentAlignment}" HorizontalAlignment="{TemplateBinding HorizontalContentAlignment}" />
</Border>
</ControlTemplate>
<Style TargetType="GridViewColumnHeader">
<Setter Property="Foreground" Value="Orange"/>
<Setter Property="FontSize" Value="30"/>
<Setter Property="Template" Value="{StaticResource GridViewHeaderTemplate}"/>
</Style>
</Grid.Resources>
<ListView .../>
</Grid>