Pivot table view is very limited. For instance, I am unable to use date fields in the X or Y axis. Additionally, only one set of rows and columns are allowed i.e. cannot have nested rows or columns.
The pivot view requires category fields for X/Y axes. This limitation, along with multiple axis tiers, will be addressed in the near future. Until then, you can duplicate and convert any other type of field to categories.