Tests for HTTP API and CLI

Job #245036 failed for f40b245a: