While the City Sleeps (1928)

A tough New York cop is determined to bring down a crook who has always managed to provide an alibi for the crimes he's been accused of, even though the detective knows he's guilty of committing them.