WireMock.net record or stub support SOAP? #319

@ibmer921150 commented on GitHub (Dec 10, 2020):

Hi @StefH, for further investigation, it looks my urls configuration is wrong. After updated the url configuration, I got the wiremock proxy protentional working, which can route the soap request to the real soap endpoint, however failed with authentication issue

SOAP client returns below error:
Message "The HTTP request is unauthorized with client authentication scheme 'Basic'. The authentication header received from the server was 'Negotiate, NTLM, Basic realm=\"xxx\"'." string

Wiremock proxy returns below error

 "Response": {
      "StatusCode": 401,
      "Body": "<!DOCTYPE HTML PUBLIC \"-//W3C//DTD HTML 4.01//EN\"\"http://www.w3.org/TR/html4/strict.dtd\">\r\n<HTML><HEAD><TITLE>Not Authorized</TITLE>\r\n<META HTTP-EQUIV=\"Content-Type\" Content=\"text/html; charset=us-ascii\"></HEAD>\r\n<BODY><h2>Not Authorized</h2>\r\n<hr><p>HTTP Error 401. The requested resource requires user authentication.</p>\r\n</BODY></HTML>\r\n",
      "Headers": {
        "Content-Type": "text/html; charset=us-ascii",
        "Content-Length": "341",
        "Server": "Microsoft-HTTPAPI/2.0",
        "WWW-Authenticate": "NTLM TlRMTVNTUAACAAAADAAMADgAAAAFgomiRIyeETdqgboAAAAAAAAAAPIA8gBEAAAABgOAJQAAAA9BAFAAUABEAEUAVgACAAwAQQBQAFAARABFAFYAAQAYAEsAQgBBAEQASQBOAFQAUwBSAFYANwAwAAQAMABhAHAAcABkAGUAdgAuAGsAaQB3AGkAYgBhAG4AawAuAGkAbgB0AGUAcgBuAGEAbAADAEoASwBCAEEARABJAE4AVABTAFIAVgA3ADAALgBhAHAAcABkAGUAdgAuAGsAaQB3AGkAYgBhAG4AawAuAGkAbgB0AGUAcgBuAGEAbAAFADAAYQBwAHAAZABlAHYALgBrAGkAdwBpAGIAYQBuAGsALgBpAG4AdABlAHIAbgBhAGwABwAIABhlg8idztYBAAAAAA==",
        "Date": "Thu, 10 Dec 2020 02:40:12 GMT"}

If I try to send soap request to real endpoint without wiremock proxy, it works fine.

Do you have any advice how the wiremock proxy handling the authentication? Or how can we config authentication in wiremock settings properly?

Thanks
Yu

@ibmer921150 commented on GitHub (Dec 10, 2020): Hi @StefH, for further investigation, it looks my urls configuration is wrong. After updated the url configuration, I got the wiremock proxy protentional working, which can route the soap request to the real soap endpoint, however failed with authentication issue SOAP client returns below error: `Message "The HTTP request is unauthorized with client authentication scheme 'Basic'. The authentication header received from the server was 'Negotiate, NTLM, Basic realm=\"xxx\"'." string` Wiremock proxy returns below error ``` json "Response": { "StatusCode": 401, "Body": "<!DOCTYPE HTML PUBLIC \"-//W3C//DTD HTML 4.01//EN\"\"http://www.w3.org/TR/html4/strict.dtd\">\r\n<HTML><HEAD><TITLE>Not Authorized</TITLE>\r\n<META HTTP-EQUIV=\"Content-Type\" Content=\"text/html; charset=us-ascii\"></HEAD>\r\n<BODY><h2>Not Authorized</h2>\r\n<hr><p>HTTP Error 401. The requested resource requires user authentication.</p>\r\n</BODY></HTML>\r\n", "Headers": { "Content-Type": "text/html; charset=us-ascii", "Content-Length": "341", "Server": "Microsoft-HTTPAPI/2.0", "WWW-Authenticate": "NTLM TlRMTVNTUAACAAAADAAMADgAAAAFgomiRIyeETdqgboAAAAAAAAAAPIA8gBEAAAABgOAJQAAAA9BAFAAUABEAEUAVgACAAwAQQBQAFAARABFAFYAAQAYAEsAQgBBAEQASQBOAFQAUwBSAFYANwAwAAQAMABhAHAAcABkAGUAdgAuAGsAaQB3AGkAYgBhAG4AawAuAGkAbgB0AGUAcgBuAGEAbAADAEoASwBCAEEARABJAE4AVABTAFIAVgA3ADAALgBhAHAAcABkAGUAdgAuAGsAaQB3AGkAYgBhAG4AawAuAGkAbgB0AGUAcgBuAGEAbAAFADAAYQBwAHAAZABlAHYALgBrAGkAdwBpAGIAYQBuAGsALgBpAG4AdABlAHIAbgBhAGwABwAIABhlg8idztYBAAAAAA==", "Date": "Thu, 10 Dec 2020 02:40:12 GMT"} ``` If I try to send soap request to real endpoint without wiremock proxy, it works fine. Do you have any advice how the wiremock proxy handling the authentication? Or how can we config authentication in wiremock settings properly? Thanks Yu

adam commented

@StefH commented on GitHub (Dec 10, 2020):

Can you please show the complete soap-request you are sending?

@StefH commented on GitHub (Dec 10, 2020): Can you please show the complete soap-request you are sending?

adam commented

@ibmer921150 commented on GitHub (Dec 14, 2020):

Hi @StefH, below is the soap request and response in wiremock.net mappings, hidden a few real data for security. FYI.

[
    {
        "Guid": "7f211b2c-4615-45b0-811d-90f6eac6bada",
        "Title": "",
        "Request": {
            "Path": {
                "Matchers": [
                    {
                        "Name": "WildcardMatcher",
                        "Pattern": "/xxx/router.svc/basic",
                        "IgnoreCase": false
                    }
                ]
            },
            "Methods": [
                "POST"
            ],
            "Headers": [
                {
                    "Name": "Cache-Control",
                    "Matchers": [
                        {
                            "Name": "WildcardMatcher",
                            "Pattern": "no-cache, max-age=0",
                            "IgnoreCase": true
                        }
                    ]
                },
                {
                    "Name": "Connection",
                    "Matchers": [
                        {
                            "Name": "WildcardMatcher",
                            "Pattern": "Keep-Alive",
                            "IgnoreCase": true
                        }
                    ]
                },
                {
                    "Name": "Content-Type",
                    "Matchers": [
                        {
                            "Name": "WildcardMatcher",
                            "Pattern": "text/xml; charset=utf-8",
                            "IgnoreCase": true
                        }
                    ]
                },
                {
                    "Name": "Accept-Encoding",
                    "Matchers": [
                        {
                            "Name": "WildcardMatcher",
                            "Pattern": "gzip, deflate",
                            "IgnoreCase": true
                        }
                    ]
                },
                {
                    "Name": "Expect",
                    "Matchers": [
                        {
                            "Name": "WildcardMatcher",
                            "Pattern": "100-continue",
                            "IgnoreCase": true
                        }
                    ]
                },
                {
                    "Name": "Host",
                    "Matchers": [
                        {
                            "Name": "WildcardMatcher",
                            "Pattern": "localhost:9091",
                            "IgnoreCase": true
                        }
                    ]
                },
                {
                    "Name": "Content-Length",
                    "Matchers": [
                        {
                            "Name": "WildcardMatcher",
                            "Pattern": "1185",
                            "IgnoreCase": true
                        }
                    ]
                },
                {
                    "Name": "SOAPAction",
                    "Matchers": [
                        {
                            "Name": "WildcardMatcher",
                            "Pattern": "\"www.xxx/V6.0.0.2/xxx/xxx/xxx/xxx/xxx/xxx\"",
                            "IgnoreCase": true
                        }
                    ]
                }
            ],
            "Body": {
                "Matcher": {
                    "Name": "ExactMatcher",
                    "Pattern": "<s:Envelope xmlns:s=\"http://schemas.xmlsoap.org/soap/envelope/\"><s:Body><xxx xmlns=\"xxx\"><request xmlns:a=\"http://schemas.datacontract.org/2004/07/CBIServices.DataContracts\" xmlns:i=\"http://www.w3.org/2001/XMLSchema-instance\"><a:Channel>NOTSPECIFIED</a:Channel><a:Organisations xmlns:b=\"xxx\">..........<remoteSystemDetails>xxx</remoteSystemDetails></xxx></s:Body></s:Envelope>"
                }
            }
        },
        "Response": {
            "StatusCode": 401,
            "Body": "You do not have permission to view this directory or page.",
            "Headers": {
                "Content-Type": "text/html",
                "Content-Length": "58",
                "Server": "Microsoft-IIS/8.5",
                "WWW-Authenticate": "Basic realm=\"xxx\"",
                "X-Powered-By": "ASP.NET",
                "Date": "Sun, 13 Dec 2020 23:05:36 GMT"
            }
        }
    }
]

@ibmer921150 commented on GitHub (Dec 14, 2020): Hi @StefH, below is the soap request and response in wiremock.net mappings, hidden a few real data for security. FYI. ``` json [ { "Guid": "7f211b2c-4615-45b0-811d-90f6eac6bada", "Title": "", "Request": { "Path": { "Matchers": [ { "Name": "WildcardMatcher", "Pattern": "/xxx/router.svc/basic", "IgnoreCase": false } ] }, "Methods": [ "POST" ], "Headers": [ { "Name": "Cache-Control", "Matchers": [ { "Name": "WildcardMatcher", "Pattern": "no-cache, max-age=0", "IgnoreCase": true } ] }, { "Name": "Connection", "Matchers": [ { "Name": "WildcardMatcher", "Pattern": "Keep-Alive", "IgnoreCase": true } ] }, { "Name": "Content-Type", "Matchers": [ { "Name": "WildcardMatcher", "Pattern": "text/xml; charset=utf-8", "IgnoreCase": true } ] }, { "Name": "Accept-Encoding", "Matchers": [ { "Name": "WildcardMatcher", "Pattern": "gzip, deflate", "IgnoreCase": true } ] }, { "Name": "Expect", "Matchers": [ { "Name": "WildcardMatcher", "Pattern": "100-continue", "IgnoreCase": true } ] }, { "Name": "Host", "Matchers": [ { "Name": "WildcardMatcher", "Pattern": "localhost:9091", "IgnoreCase": true } ] }, { "Name": "Content-Length", "Matchers": [ { "Name": "WildcardMatcher", "Pattern": "1185", "IgnoreCase": true } ] }, { "Name": "SOAPAction", "Matchers": [ { "Name": "WildcardMatcher", "Pattern": "\"www.xxx/V6.0.0.2/xxx/xxx/xxx/xxx/xxx/xxx\"", "IgnoreCase": true } ] } ], "Body": { "Matcher": { "Name": "ExactMatcher", "Pattern": "<s:Envelope xmlns:s=\"http://schemas.xmlsoap.org/soap/envelope/\"><s:Body><xxx xmlns=\"xxx\"><request xmlns:a=\"http://schemas.datacontract.org/2004/07/CBIServices.DataContracts\" xmlns:i=\"http://www.w3.org/2001/XMLSchema-instance\"><a:Channel>NOTSPECIFIED</a:Channel><a:Organisations xmlns:b=\"xxx\">..........<remoteSystemDetails>xxx</remoteSystemDetails></xxx></s:Body></s:Envelope>" } } }, "Response": { "StatusCode": 401, "Body": "You do not have permission to view this directory or page.", "Headers": { "Content-Type": "text/html", "Content-Length": "58", "Server": "Microsoft-IIS/8.5", "WWW-Authenticate": "Basic realm=\"xxx\"", "X-Powered-By": "ASP.NET", "Date": "Sun, 13 Dec 2020 23:05:36 GMT" } } } ] ```

adam commented

@StefH commented on GitHub (Dec 14, 2020):

At first look it seems that the authentication header is not send by you, or that this header is not recorded?

Can you also post here the complete original soap request ?

@StefH commented on GitHub (Dec 14, 2020): At first look it seems that the authentication header is not send by you, or that this header is not recorded? Can you also post here the complete original soap request ?

adam commented

@ibmer921150 commented on GitHub (Dec 15, 2020):

hi @StefH,

When I monitor the soap transactions sending out from wiremock via fiddler or wireshark. I can see the auth header (Basic xxxxx) has been removed. When the soap transaction sending to endpoint directly, the auth (Basic xxxx) existed in the http header via fiddler or wireshark. I guess the wiremock may do some strange thing for the auth header?

Thanks
Yu

@ibmer921150 commented on GitHub (Dec 15, 2020): hi @StefH, When I monitor the soap transactions sending out from wiremock via fiddler or wireshark. I can see the auth header (Basic xxxxx) has been removed. When the soap transaction sending to endpoint directly, the auth (Basic xxxx) existed in the http header via fiddler or wireshark. I guess the wiremock may do some strange thing for the auth header? Thanks Yu

adam commented

@ibmer921150 commented on GitHub (Dec 15, 2020):

Sorry @StefH I can not provide the complete original soap request as it is confidential.

@ibmer921150 commented on GitHub (Dec 15, 2020): Sorry @StefH I can not provide the complete original soap request as it is confidential.

adam commented

@StefH commented on GitHub (Dec 15, 2020):

No problem. I'll investigate the code on the basic authentication header.

BTW what framework do you use?

@StefH commented on GitHub (Dec 15, 2020): No problem. I'll investigate the code on the basic authentication header. BTW what framework do you use?

adam commented

https://github.com/WireMock-Net/WireMock.Net/pull/555

@StefH commented on GitHub (Dec 15, 2020):

@StefH commented on GitHub (Dec 15, 2020): https://github.com/WireMock-Net/WireMock.Net/pull/555

adam commented

@StefH commented on GitHub (Dec 15, 2020):

@ibmer921150 I'm not able to reproduce this problem with a UnitTest, so if you please can post the complete SOAP HTTP request (without confidential data) that would help me a lot.

@StefH commented on GitHub (Dec 15, 2020): @ibmer921150 I'm not able to reproduce this problem with a UnitTest, so if you please can post the complete SOAP HTTP request (without confidential data) that would help me a lot.

adam commented

@ibmer921150 commented on GitHub (Dec 15, 2020):

Thanks @StefH. Please review the two SOAP HTTP requests between wiremock and direct endpoint, captured via Wireshark, included header and request.

Wiremock

Direct endpoint

@ibmer921150 commented on GitHub (Dec 15, 2020): Thanks @StefH. Please review the two SOAP HTTP requests between wiremock and direct endpoint, captured via Wireshark, included header and request. **Wiremock** ![image](https://user-images.githubusercontent.com/13460590/102259422-f5a5ba00-3f73-11eb-830e-2e34012e3f5a.png) **Direct endpoint** ![image](https://user-images.githubusercontent.com/13460590/102259262-c1ca9480-3f73-11eb-81b4-ec5d33d31c4c.png)

adam commented

@StefH commented on GitHub (Dec 15, 2020):

@ibmer921150
How do you configure the proxying?

Via global settings & proxy settings?
Via .WithProxy(...)

@StefH commented on GitHub (Dec 15, 2020): @ibmer921150 How do you configure the proxying? 1. Via global settings & proxy settings? 2. Via `.WithProxy(...)`

adam commented

@StefH commented on GitHub (Dec 15, 2020):

If I use this code:

var server = WireMockServer.Start(new WireMockServerSettings
{
    Urls = new[] { "http://localhost:9091", "https://localhost:9443" },
    StartAdminInterface = true,
    ReadStaticMappings = false,
    ProxyAndRecordSettings = new ProxyAndRecordSettings
    {
        Url = "http://postman-echo.com/post",
        //ClientX509Certificate2ThumbprintOrSubjectName = "www.yourclientcertname.com OR yourcertificatethumbprint (only if the service you're proxying to requires it)",
        SaveMapping = true,
        SaveMappingToFile = false,
        ExcludedHeaders = new[] { "dnt", "Content-Length" }
    }
});

And send a post request with Authorization to WireMock.Net , the response from postman echo does contain the header:

@StefH commented on GitHub (Dec 15, 2020): If I use this code: ``` c# var server = WireMockServer.Start(new WireMockServerSettings { Urls = new[] { "http://localhost:9091", "https://localhost:9443" }, StartAdminInterface = true, ReadStaticMappings = false, ProxyAndRecordSettings = new ProxyAndRecordSettings { Url = "http://postman-echo.com/post", //ClientX509Certificate2ThumbprintOrSubjectName = "www.yourclientcertname.com OR yourcertificatethumbprint (only if the service you're proxying to requires it)", SaveMapping = true, SaveMappingToFile = false, ExcludedHeaders = new[] { "dnt", "Content-Length" } } }); ``` And send a post request with Authorization to WireMock.Net , the response from postman echo does contain the header: ![image](https://user-images.githubusercontent.com/249938/102261958-b3985c00-3f12-11eb-8ad6-bb9010aa0a3c.png)

adam commented

@ibmer921150 commented on GitHub (Dec 15, 2020):

@StefH here is my configuration, similar like yours. BTW, your example is API JSON request which is not exactly the same as SOAP header, such as content-type should be text/xml, including soapactions and etc. The c# source code setup the header and auth would be different. I am not expert of c#, I will join our dev to look into the source code of wiremock.net. Cheers.

using System;
using Newtonsoft.Json;
using WireMock.Server;
using WireMock.Settings;

namespace WiremockDotnet
{
    class Program
    {

        static void Main(params string[] args)
        {
            var server = WireMockServer.Start(new WireMockServerSettings
            {
       
                Urls = new[] { "http://xxx:9091/" },
                StartAdminInterface = true,
                Logger = new WireMock.Logging.WireMockConsoleLogger(),
                //ReadStaticMappings = false,
                ProxyAndRecordSettings = new ProxyAndRecordSettings
                {
                    Url = "http://xxx/",
                    //ClientX509Certificate2ThumbprintOrSubjectName = "www.yourclientcertname.com OR yourcertificatethumbprint (only if the service you're proxying to requires it)",
                    SaveMapping = true,
                    SaveMappingToFile = true,

                    //ExcludedHeaders = new[] { "dnt", "Content-Length" }
                },
                //Logger = new WireMock.Logging.WireMockNullLogger(),
            });
            System.Console.WriteLine("Press any key to stop the server");
            System.Console.ReadKey();
            server.Stop();
            System.Console.WriteLine("Displaying all requests");
            var allRequests = server.LogEntries;
            System.Console.WriteLine(JsonConvert.SerializeObject(allRequests, Formatting.Indented));
            System.Console.WriteLine("Press any key to quit");
            System.Console.ReadKey();
        }
    }
}

@ibmer921150 commented on GitHub (Dec 15, 2020): @StefH here is my configuration, similar like yours. BTW, your example is API JSON request which is not exactly the same as SOAP header, such as content-type should be text/xml, including soapactions and etc. The c# source code setup the header and auth would be different. I am not expert of c#, I will join our dev to look into the source code of wiremock.net. Cheers. ``` c# using System; using Newtonsoft.Json; using WireMock.Server; using WireMock.Settings; namespace WiremockDotnet { class Program { static void Main(params string[] args) { var server = WireMockServer.Start(new WireMockServerSettings { Urls = new[] { "http://xxx:9091/" }, StartAdminInterface = true, Logger = new WireMock.Logging.WireMockConsoleLogger(), //ReadStaticMappings = false, ProxyAndRecordSettings = new ProxyAndRecordSettings { Url = "http://xxx/", //ClientX509Certificate2ThumbprintOrSubjectName = "www.yourclientcertname.com OR yourcertificatethumbprint (only if the service you're proxying to requires it)", SaveMapping = true, SaveMappingToFile = true, //ExcludedHeaders = new[] { "dnt", "Content-Length" } }, //Logger = new WireMock.Logging.WireMockNullLogger(), }); System.Console.WriteLine("Press any key to stop the server"); System.Console.ReadKey(); server.Stop(); System.Console.WriteLine("Displaying all requests"); var allRequests = server.LogEntries; System.Console.WriteLine(JsonConvert.SerializeObject(allRequests, Formatting.Indented)); System.Console.WriteLine("Press any key to quit"); System.Console.ReadKey(); } } } ```

adam commented

@ibmer921150 commented on GitHub (Dec 16, 2020):

@StefH For further investigation today, I constructed the soap request via Postman and sent soap request to wiremock proxy. It can record the request mappings and response mappings successfully. Now the problem is more like our application is doing some strange things which can not be compatible with the wiremock proxy. I will do some further investigations and provide the PR if required. Thanks for your time on the question.

BTW, do we have any examples how to playback the exited mappings(JSON files) in stub mode? I assume it might be like wiremock.org that “Playback” doesn’t require any explicit action. But actually it is not for wiremock.net. Sorry I didn't find the related information in the wiki page, maybe I missed it...

@ibmer921150 commented on GitHub (Dec 16, 2020): @StefH For further investigation today, I constructed the soap request via Postman and sent soap request to wiremock proxy. It can record the request mappings and response mappings successfully. Now the problem is more like our application is doing some strange things which can not be compatible with the wiremock proxy. I will do some further investigations and provide the PR if required. Thanks for your time on the question. BTW, do we have any examples how to playback the exited mappings(JSON files) in stub mode? I assume it might be like wiremock.org that “Playback” doesn’t require any explicit action. But actually it is not for wiremock.net. Sorry I didn't find the related information in the wiki page, maybe I missed it...

adam commented

@ibmer921150 commented on GitHub (Dec 16, 2020):

Above issue seems to be fixed after adding below:

AllowPartialMapping = true

@ibmer921150 commented on GitHub (Dec 16, 2020): Above issue seems to be fixed after adding below: AllowPartialMapping = true

adam commented