starred/WireMock.Net
1
0
Fork 0
mirror of https://github.com/wiremock/WireMock.Net.git synced 2026-01-11 21:10:32 +01:00
Code Issues 32 Packages Projects Releases 10 Wiki Activity

FormEncoded Request fails (404 Not Found) if key value pairs order in mapping is different from request body order #615

New Issue
Closed
opened 2025-12-29 08:30:59 +01:00 by adam · 19 comments
adam commented 2025-12-29 08:30:59 +01:00
Owner
Copy Link

Originally created by @Xor-el on GitHub (Jul 24, 2024).

Originally assigned to: @StefH on GitHub.

Describe the bug

When trying to use the ExactMatcher or RegexMatcher to match a form encoded request, it fails (404 Not Found) if they order of the form encoded request is different from that in the json mapping file.

Expected behavior:

Ordering of FormEncoded Body requests should not affect matching as it might not always be convenient to control the ordering.
If it is going to be a breaking change to fix this, a flag like IgnoreFormEncodedBodyOrder can be provided to override the default.

Test to reproduce

  • 1 Clone Repo, and build.
  • 2 Run the built demo. (Incase you get an error the first time you run the Demo, close it and run again.).

Other related info

Docker is needed to run the Demo as it uses WireMock.NET Test Container.

Originally created by @Xor-el on GitHub (Jul 24, 2024). Originally assigned to: @StefH on GitHub. ### Describe the bug When trying to use the `ExactMatcher` or `RegexMatcher` to match a form encoded request, it fails (404 Not Found) if they order of the form encoded request is different from that in the json mapping file. ### Expected behavior: Ordering of FormEncoded Body requests should not affect matching as it might not always be convenient to control the ordering. If it is going to be a breaking change to fix this, a flag like `IgnoreFormEncodedBodyOrder` can be provided to override the default. ### Test to reproduce - 1 Clone [Repo](https://github.com/Xor-el/WireMock.NET-FormEncoded-Body-Bug-Demo), and build. - 2 Run the built demo. (Incase you get an error the first time you run the Demo, close it and run again.). ### Other related info Docker is needed to run the Demo as it uses WireMock.NET Test Container.
adam added the bug label 2025-12-29 08:30:59 +01:00
adam closed this issue 2025-12-29 08:30:59 +01:00
adam commented 2025-12-29 08:30:59 +01:00
Author
Owner
Copy Link

@StefH commented on GitHub (Jul 24, 2024):

The ExactMatcher or RegexMatcher should just be used to match a string value. In case you want to match a form-urlencoded body, a better approach would be to add a new matcher like FormUrlEncodedMatcher which can be used like this?

"Body": {
      "Matcher": {
        "Name": "FormUrlEncodedMatcher",
        "Patterns": [
           "grant_type=client_credentials",
           "client_id=DDCD99EE1531484E4E21D5EC9FBA5D8B",
           "client_secret=RERDRDk5RUUxNTMxNDg0RTRFMjFENUVDOUZCQTVEOEI%3D"
         ]
      }
    }
@StefH commented on GitHub (Jul 24, 2024): The `ExactMatcher` or `RegexMatcher` should just be used to match a string value. In case you want to match a form-urlencoded body, a better approach would be to add a new matcher like `FormUrlEncodedMatcher` which can be used like this? ``` json "Body": { "Matcher": { "Name": "FormUrlEncodedMatcher", "Patterns": [ "grant_type=client_credentials", "client_id=DDCD99EE1531484E4E21D5EC9FBA5D8B", "client_secret=RERDRDk5RUUxNTMxNDg0RTRFMjFENUVDOUZCQTVEOEI%3D" ] } } ```
adam commented 2025-12-29 08:31:00 +01:00
Author
Owner
Copy Link

@Xor-el commented on GitHub (Jul 24, 2024):

Hello @StefH thanks for your quick feedback.
I agree with your suggestion that adding a new matcher would be overall a better approach to address this.
Thanks for looking into this.

@Xor-el commented on GitHub (Jul 24, 2024): Hello @StefH thanks for your quick feedback. I agree with your suggestion that adding a new matcher would be overall a better approach to address this. Thanks for looking into this.
adam commented 2025-12-29 08:31:00 +01:00
Author
Owner
Copy Link

@StefH commented on GitHub (Jul 27, 2024):

https://github.com/WireMock-Net/WireMock.Net/pull/1147

@StefH commented on GitHub (Jul 27, 2024): https://github.com/WireMock-Net/WireMock.Net/pull/1147
adam commented 2025-12-29 08:31:00 +01:00
Author
Owner
Copy Link

@StefH commented on GitHub (Jul 27, 2024):

@Xor-el
Can you double check the PR (https://github.com/WireMock-Net/WireMock.Net/pull/1147)
And I've updated the wiki: https://github.com/WireMock-Net/WireMock.Net/wiki/Request-Matcher-FormUrlEncodedMatcher

@StefH commented on GitHub (Jul 27, 2024): @Xor-el Can you double check the PR (https://github.com/WireMock-Net/WireMock.Net/pull/1147) And I've updated the wiki: https://github.com/WireMock-Net/WireMock.Net/wiki/Request-Matcher-FormUrlEncodedMatcher
adam commented 2025-12-29 08:31:01 +01:00
Author
Owner
Copy Link

@Xor-el commented on GitHub (Jul 27, 2024):

Hello @StefH Reviewing the PR and Doc now.

@Xor-el commented on GitHub (Jul 27, 2024): Hello @StefH Reviewing the PR and Doc now.
adam commented 2025-12-29 08:31:01 +01:00
Author
Owner
Copy Link

@Xor-el commented on GitHub (Jul 27, 2024):

So just reviewed this and everything looks awesome. Thanks.
while reviewing, a thought came to my head. does it make sense to have something like a FormUrlEncodedPartialMatcher, similar to how JsonPartialMatcher does partial matching or does the MatchOperator functionality cover this?

@Xor-el commented on GitHub (Jul 27, 2024): So just reviewed this and everything looks awesome. Thanks. while reviewing, a thought came to my head. does it make sense to have something like a `FormUrlEncodedPartialMatcher`, similar to how `JsonPartialMatcher` does partial matching or does the `MatchOperator` functionality cover this?
adam commented 2025-12-29 08:31:01 +01:00
Author
Owner
Copy Link

@StefH commented on GitHub (Jul 27, 2024):

By default the MatchOperator is set to Or.
So when the matcher is like:

 "Patterns": [
           "grant_type=client_credentials",
           "client_id=DDCD99EE1531484E4E21D5EC9FBA5D8B",
           "client_secret=RERDRDk5RUUxNTMxNDg0RTRFMjFENUVDOUZCQTVEOEI%3D"
         ]

And the body only contains grant_type=client_credentials, this matcher will match.

A FormUrlEncodedPartialMatcher could be used like this (I think)...

"Patterns": [
           "grant_type=*",
           "client_id=DD*",
           "*=RERDRDk5RUUxNTMxNDg0RTRFMjFENUVDOUZCQTVEOEI%3D"
         ]

I'll check if I can change the implementation from the FormUrlEncodedMatcher to use internally the WildcardMatcher for string compare...

@StefH commented on GitHub (Jul 27, 2024): By default the `MatchOperator` is set to **Or**. So when the matcher is like: ``` json "Patterns": [ "grant_type=client_credentials", "client_id=DDCD99EE1531484E4E21D5EC9FBA5D8B", "client_secret=RERDRDk5RUUxNTMxNDg0RTRFMjFENUVDOUZCQTVEOEI%3D" ] ``` And the body only contains `grant_type=client_credentials`, this matcher will match. --- A `FormUrlEncodedPartialMatcher` could be used like this (I think)... ``` json "Patterns": [ "grant_type=*", "client_id=DD*", "*=RERDRDk5RUUxNTMxNDg0RTRFMjFENUVDOUZCQTVEOEI%3D" ] ``` I'll check if I can change the implementation from the FormUrlEncodedMatcher to use internally the WildcardMatcher for string compare...
adam commented 2025-12-29 08:31:02 +01:00
Author
Owner
Copy Link

@Xor-el commented on GitHub (Jul 27, 2024):

and if it's the other way,

"Patterns": [
           "grant_type=client_credentials"
         ]

And the body contains grant_type=client_credentials, client_id=DDCD99EE1531484E4E21D5EC9FBA5D8B, and client_secret=RERDRDk5RUUxNTMxNDg0RTRFMjFENUVDOUZCQTVEOEI%3D I am guessing the matching would still work right or only the FormUrlEncodedPartialMatcher would work then?

@Xor-el commented on GitHub (Jul 27, 2024): and if it's the other way, ```json "Patterns": [ "grant_type=client_credentials" ] ```` And the body contains `grant_type=client_credentials`, `client_id=DDCD99EE1531484E4E21D5EC9FBA5D8B`, and `client_secret=RERDRDk5RUUxNTMxNDg0RTRFMjFENUVDOUZCQTVEOEI%3D` I am guessing the matching would still work right or only the `FormUrlEncodedPartialMatcher` would work then?
adam commented 2025-12-29 08:31:02 +01:00
Author
Owner
Copy Link

@StefH commented on GitHub (Jul 27, 2024):

and if it's the other way,

"Patterns": [
           "grant_type=client_credentials"
         ]

And the body contains grant_type=client_credentials, client_id=DDCD99EE1531484E4E21D5EC9FBA5D8B, and client_secret=RERDRDk5RUUxNTMxNDg0RTRFMjFENUVDOUZCQTVEOEI%3D I am guessing the matching would still work right or only the FormUrlEncodedPartialMatcher would work then?

This does already work like it is because Or is used.

@StefH commented on GitHub (Jul 27, 2024): > and if it's the other way, > > ```json > "Patterns": [ > "grant_type=client_credentials" > ] > ``` > > And the body contains `grant_type=client_credentials`, `client_id=DDCD99EE1531484E4E21D5EC9FBA5D8B`, and `client_secret=RERDRDk5RUUxNTMxNDg0RTRFMjFENUVDOUZCQTVEOEI%3D` I am guessing the matching would still work right or only the `FormUrlEncodedPartialMatcher` would work then? This does already work like it is because **Or** is used.
adam commented 2025-12-29 08:31:03 +01:00
Author
Owner
Copy Link

@Xor-el commented on GitHub (Jul 27, 2024):

great then, thanks.

@Xor-el commented on GitHub (Jul 27, 2024): great then, thanks.
adam commented 2025-12-29 08:31:03 +01:00
Author
Owner
Copy Link

@StefH commented on GitHub (Jul 27, 2024):

I've just updated the code so that wildcards are supported.
See the FormUrlEncodedMatcherTest for details.

@StefH commented on GitHub (Jul 27, 2024): I've just updated the code so that wildcards are supported. See the FormUrlEncodedMatcherTest for details.
adam commented 2025-12-29 08:31:03 +01:00
Author
Owner
Copy Link

@Xor-el commented on GitHub (Jul 27, 2024):

LGTM 🚀

@Xor-el commented on GitHub (Jul 27, 2024): LGTM :rocket:
adam commented 2025-12-29 08:31:03 +01:00
Author
Owner
Copy Link

@Xor-el commented on GitHub (Jul 29, 2024):

Hello @StefH I updated the test container package to version 1.5.62 which I assume contains the FormUrlEncodedMatcher changes.
unfortunately, the matching still returns 404 error.

I updated the Demo to reflect this issue.
can you please confirm if I am missing something?

@Xor-el commented on GitHub (Jul 29, 2024): Hello @StefH I updated the test container package to version `1.5.62` which I assume contains the `FormUrlEncodedMatcher` changes. unfortunately, the matching still returns 404 error. I updated the [Demo](https://github.com/Xor-el/WireMock.NET-FormEncoded-Body-Bug-Demo) to reflect this issue. can you please confirm if I am missing something?
adam commented 2025-12-29 08:31:03 +01:00
Author
Owner
Copy Link

@StefH commented on GitHub (Jul 29, 2024):

I could not test using docker container, but I just started latest dotnet-wiremock and updated your program.cs to be like

// See https://aka.ms/new-console-template for more information
using Newtonsoft.Json;
// using WireMock.Net.Testcontainers;

//var container = new WireMockContainerBuilder().WithMappings(Helper.MappingsPath)
//                                              .WithAutoRemove(true)
//                                              .WithCleanUp(true)
//                                              .Build();

//await container.StartAsync().ConfigureAwait(false);

//var publicBaseUrl = container.GetPublicUrl() + "api";

//Console.WriteLine("baseUrl = " + publicBaseUrl);

//var wireMockAdminClient = container.CreateWireMockAdminClient();

//var settings = await wireMockAdminClient.GetSettingsAsync();
//Console.WriteLine("settings = " + JsonConvert.SerializeObject(settings, Formatting.Indented));

//var mappings = await wireMockAdminClient.GetMappingsAsync();
//Console.WriteLine("mappings = " + JsonConvert.SerializeObject(mappings, Formatting.Indented));

var client = new HttpClient();
var publicBaseUrl = "http://localhost:9091/api";
client.BaseAddress = new Uri(publicBaseUrl);

Console.WriteLine("=================================Starting OrderedContent Tests=================================");

// grant_type is first both here and in the mapping file
var orderedContent = new FormUrlEncodedContent(
[
    new KeyValuePair<string, string>("grant_type", "client_credentials"),
    new KeyValuePair<string, string>("client_id", "DDCD99EE1531484E4E21D5EC9FBA5D8B"),
    new KeyValuePair<string, string>("client_secret", "RERDRDk5RUUxNTMxNDg0RTRFMjFENUVDOUZCQTVEOEI=")
]);

//var exactOrderedContentResponse = await client.PostAsync($"{publicBaseUrl}/exact", orderedContent).ConfigureAwait(false);

//Console.WriteLine("ExactOrderedContent Response = " + exactOrderedContentResponse.StatusCode);

//var regexOrderedContentResponse = await client.PostAsync($"{publicBaseUrl}/regex", orderedContent).ConfigureAwait(false);

//Console.WriteLine("RegexOrderedContent Response = " + regexOrderedContentResponse.StatusCode);

var formUrlEncodedOrderedContentResponse = await client.PostAsync($"{publicBaseUrl}/formurlencoded", orderedContent).ConfigureAwait(false);

Console.WriteLine("FormUrlEncodedOrderedContent Response = " + formUrlEncodedOrderedContentResponse.StatusCode);

Console.WriteLine("=================================Starting UnOrderedContent Tests=================================");

// order changed, grant_type is now last here but still first in mapping file
var unOrderedContent = new FormUrlEncodedContent(
[
    new KeyValuePair<string, string>("client_id", "DDCD99EE1531484E4E21D5EC9FBA5D8B"),
    new KeyValuePair<string, string>("client_secret", "RERDRDk5RUUxNTMxNDg0RTRFMjFENUVDOUZCQTVEOEI="),
    new KeyValuePair<string, string>("grant_type", "client_credentials"),
]);

//var exactUnOrderedContentResponse = await client.PostAsync($"{publicBaseUrl}/exact", unOrderedContent).ConfigureAwait(false);

//Console.WriteLine("ExactOrderedContent Response = " + exactUnOrderedContentResponse.StatusCode);

//var regexUnOrderedContentResponse = await client.PostAsync($"{publicBaseUrl}/regex", unOrderedContent).ConfigureAwait(false);

//Console.WriteLine("RegexOrderedContent Response = " + regexUnOrderedContentResponse.StatusCode);

var formUrlEncodedUnOrderedContentResponse = await client.PostAsync($"{publicBaseUrl}/formurlencoded", unOrderedContent).ConfigureAwait(false);

Console.WriteLine("FormUrlEncodedUnOrderedContent Response = " + formUrlEncodedUnOrderedContentResponse.StatusCode);


//await container.StopAsync();

Console.WriteLine("Finished Operations");

Console.ReadLine();

public static class Helper
{
    private static Lazy<string> RootProjectPath { get; } = new(() =>
    {
        var directoryInfo = new DirectoryInfo(AppContext.BaseDirectory);
        do
        {
            directoryInfo = directoryInfo.Parent!;
        } while (!directoryInfo.Name.EndsWith("WireMock.NET-FormEncoded-Body-Bug-Demo", StringComparison.OrdinalIgnoreCase));

        return directoryInfo.FullName;
    });

    public static string MappingsPath => Path.Combine(RootProjectPath.Value, "Mappings");
}

And it works:
image

In case you want to know why the mapping is not matched, follow this page:
https://github.com/WireMock-Net/WireMock.Net/wiki/Request-Matching-Tips

@StefH commented on GitHub (Jul 29, 2024): I could not test using docker container, but I just started latest `dotnet-wiremock` and updated your program.cs to be like ``` c# // See https://aka.ms/new-console-template for more information using Newtonsoft.Json; // using WireMock.Net.Testcontainers; //var container = new WireMockContainerBuilder().WithMappings(Helper.MappingsPath) // .WithAutoRemove(true) // .WithCleanUp(true) // .Build(); //await container.StartAsync().ConfigureAwait(false); //var publicBaseUrl = container.GetPublicUrl() + "api"; //Console.WriteLine("baseUrl = " + publicBaseUrl); //var wireMockAdminClient = container.CreateWireMockAdminClient(); //var settings = await wireMockAdminClient.GetSettingsAsync(); //Console.WriteLine("settings = " + JsonConvert.SerializeObject(settings, Formatting.Indented)); //var mappings = await wireMockAdminClient.GetMappingsAsync(); //Console.WriteLine("mappings = " + JsonConvert.SerializeObject(mappings, Formatting.Indented)); var client = new HttpClient(); var publicBaseUrl = "http://localhost:9091/api"; client.BaseAddress = new Uri(publicBaseUrl); Console.WriteLine("=================================Starting OrderedContent Tests================================="); // grant_type is first both here and in the mapping file var orderedContent = new FormUrlEncodedContent( [ new KeyValuePair<string, string>("grant_type", "client_credentials"), new KeyValuePair<string, string>("client_id", "DDCD99EE1531484E4E21D5EC9FBA5D8B"), new KeyValuePair<string, string>("client_secret", "RERDRDk5RUUxNTMxNDg0RTRFMjFENUVDOUZCQTVEOEI=") ]); //var exactOrderedContentResponse = await client.PostAsync($"{publicBaseUrl}/exact", orderedContent).ConfigureAwait(false); //Console.WriteLine("ExactOrderedContent Response = " + exactOrderedContentResponse.StatusCode); //var regexOrderedContentResponse = await client.PostAsync($"{publicBaseUrl}/regex", orderedContent).ConfigureAwait(false); //Console.WriteLine("RegexOrderedContent Response = " + regexOrderedContentResponse.StatusCode); var formUrlEncodedOrderedContentResponse = await client.PostAsync($"{publicBaseUrl}/formurlencoded", orderedContent).ConfigureAwait(false); Console.WriteLine("FormUrlEncodedOrderedContent Response = " + formUrlEncodedOrderedContentResponse.StatusCode); Console.WriteLine("=================================Starting UnOrderedContent Tests================================="); // order changed, grant_type is now last here but still first in mapping file var unOrderedContent = new FormUrlEncodedContent( [ new KeyValuePair<string, string>("client_id", "DDCD99EE1531484E4E21D5EC9FBA5D8B"), new KeyValuePair<string, string>("client_secret", "RERDRDk5RUUxNTMxNDg0RTRFMjFENUVDOUZCQTVEOEI="), new KeyValuePair<string, string>("grant_type", "client_credentials"), ]); //var exactUnOrderedContentResponse = await client.PostAsync($"{publicBaseUrl}/exact", unOrderedContent).ConfigureAwait(false); //Console.WriteLine("ExactOrderedContent Response = " + exactUnOrderedContentResponse.StatusCode); //var regexUnOrderedContentResponse = await client.PostAsync($"{publicBaseUrl}/regex", unOrderedContent).ConfigureAwait(false); //Console.WriteLine("RegexOrderedContent Response = " + regexUnOrderedContentResponse.StatusCode); var formUrlEncodedUnOrderedContentResponse = await client.PostAsync($"{publicBaseUrl}/formurlencoded", unOrderedContent).ConfigureAwait(false); Console.WriteLine("FormUrlEncodedUnOrderedContent Response = " + formUrlEncodedUnOrderedContentResponse.StatusCode); //await container.StopAsync(); Console.WriteLine("Finished Operations"); Console.ReadLine(); public static class Helper { private static Lazy<string> RootProjectPath { get; } = new(() => { var directoryInfo = new DirectoryInfo(AppContext.BaseDirectory); do { directoryInfo = directoryInfo.Parent!; } while (!directoryInfo.Name.EndsWith("WireMock.NET-FormEncoded-Body-Bug-Demo", StringComparison.OrdinalIgnoreCase)); return directoryInfo.FullName; }); public static string MappingsPath => Path.Combine(RootProjectPath.Value, "Mappings"); } ``` And it works: ![image](https://github.com/user-attachments/assets/f9ab1dd3-088e-4f47-ae41-17a21e498188) --- In case you want to know why the mapping is not matched, follow this page: https://github.com/WireMock-Net/WireMock.Net/wiki/Request-Matching-Tips
adam commented 2025-12-29 08:31:03 +01:00
Author
Owner
Copy Link

@Xor-el commented on GitHub (Jul 29, 2024):

@StefH my bad actually. I forgot to clear my Stale Docker Image Cache so my test container was using the old cached 1.5.60 instead of the latest 1.5.62 image.

Thanks for your time.

@Xor-el commented on GitHub (Jul 29, 2024): @StefH my bad actually. I forgot to clear my Stale Docker Image Cache so my test container was using the old cached 1.5.**60** instead of the latest 1.5.**62** image. Thanks for your time.
adam commented 2025-12-29 08:31:04 +01:00
Author
Owner
Copy Link

@StefH commented on GitHub (Jul 29, 2024):

@Xor-el
Currently the latest is always used.
Would it be needed to add an option to manually specify the version when using the containerbuilder? Or is this not needed?

@StefH commented on GitHub (Jul 29, 2024): @Xor-el Currently the `latest` is always used. Would it be needed to add an option to manually specify the version when using the containerbuilder? Or is this not needed?
adam commented 2025-12-29 08:31:04 +01:00
Author
Owner
Copy Link

@Xor-el commented on GitHub (Jul 29, 2024):

@StefH

Currently the latest is always used.

So, Docker Desktop normally caches the downloaded image and reuses it on subsequent builds if it exists so I don't think there is much you can do about that on your end except there is a way to force Docker to always pull when a build is about to happen (but this has it's own disadvantage too).

Would it be needed to add an option to manually specify the version when using the containerbuilder? Or is this not needed?

it would be nice to have the ability to pin the version we wish to use to enable users to work around scenarios like this, which happened some days back to the SQL Server test container image.

@Xor-el commented on GitHub (Jul 29, 2024): @StefH > Currently the latest is always used. So, Docker Desktop normally caches the downloaded image and reuses it on subsequent builds if it exists so I don't think there is much you can do about that on your end except there is a way to force Docker to always pull when a build is about to happen (but this has it's own disadvantage too). > Would it be needed to add an option to manually specify the version when using the containerbuilder? Or is this not needed? it would be nice to have the ability to pin the version we wish to use to enable users to work around scenarios like [this](https://github.com/testcontainers/testcontainers-dotnet/issues/1220), which happened some days back to the SQL Server test container image.
adam commented 2025-12-29 08:31:04 +01:00
Author
Owner
Copy Link

@StefH commented on GitHub (Jul 29, 2024):

Can you create a new issue please?

@StefH commented on GitHub (Jul 29, 2024): Can you create a new issue please?
adam commented 2025-12-29 08:31:04 +01:00
Author
Owner
Copy Link

@Xor-el commented on GitHub (Jul 29, 2024):

sure, on it.

@Xor-el commented on GitHub (Jul 29, 2024): sure, on it.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
bug
doc
doc
duplicate
feature
feature
invalid
pull-request
Mirrored from GitHub Pull Request
 question
wontfix
No Label bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
adam
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: starred/WireMock.Net#615
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?