Abraham Lincoln was the first Republican president to give inaugural address and that was on March 4, 1861