Chase Rice still remembers his father's rough and calloused hands. "He was one of them tough guys that you read about, one of those grandpa types that's just tough as s—" Rice, 37, tells PEOPLE ...