Set custom encoding when post a urlencoded data

[mirusu400]

httpx/httpx/_content.py

Lines 137 to 150 in a8dd079

	def encode_urlencoded_data(
	data: RequestData,
	) -> Tuple[Dict[str, str], ByteStream]:
	plain_data = []
	for key, value in data.items():
	if isinstance(value, (list, tuple)):
	plain_data.extend([(key, primitive_value_to_str(item)) for item in value])
	else:
	plain_data.append((key, primitive_value_to_str(value)))
	body = urlencode(plain_data, doseq=True).encode("utf-8")
	content_length = str(len(body))
	content_type = "application/x-www-form-urlencoded"
	headers = {"Content-Length": content_length, "Content-Type": content_type}
	return headers, ByteStream(body)

Here, we are encode a data to url-encoded data via urlencode function in urllib.parse

But we can't specify which encoding to urlencode in (The default urlencode's encoding is UTF-8.)

We need to make an option for urlencode for some websites with other charset.

request.post method automatically recognize data's encoding when we encode the dict data, but httpx can't.

Example Server / Client

Server (Written in PHP)

<?php
	// Set encoding
	header('Content-Type: text/html; charset=euc-kr');
	$data = $_POST['test'];
	echo $data;
?>

Client

import requests
import httpx

# Set encode type
headers = {
    "Content-Type": "application/x-www-form-urlencoded; charset=euc-kr"
}

r = requests.post("http://localhost/test.php", data={
    "test": "안녕하세요".encode("euc-kr")
}, headers=headers)

# Return "안녕하세요"
print(r.text)

httpxClient = httpx.Client()
r = httpxClient.post("http://localhost/test.php", data={
    "test": "안녕하세요".encode("euc-kr")
}, headers=headers)

# Return b'\xbe\xc8\xb3\xe7\xc7\xcf\xbc\xbc\xbf\xe4'
print(r.text) # Not work

r = httpxClient.post("http://localhost/test.php", data={
    "test": "안녕하세요"
}, headers=headers)

# Return �����������몄��
print(r.text)