When I change assignee why is the Old Assignee and New Assignee notified?
Because thats what JIRA does, its not a bug, see https://confluence.atlassian.com/display/JIRA/Creating+a+Notification+Scheme
JIRA will send notification emails to both the previous assignee and the current assignee, whenever the assignee field changes.