That's actually a very interesting question.

It probably can develop what are essentially preferences, but they'd be its preferences and not human preferences, which raises the question of whether about AI preferences matter.