Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Variable TCP Telnet ports via web interface #205

Open
wants to merge 64 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from 38 commits
Commits
Show all changes
64 commits
Select commit Hold shift + click to select a range
563957f
Update home.html
fuzzball03 Oct 27, 2016
143eb24
Update ui.js
fuzzball03 Oct 27, 2016
eb7fde7
Update cgipins.c
fuzzball03 Oct 27, 2016
5cb0350
Update config.h
fuzzball03 Oct 27, 2016
fb1bbd3
Update config.h
fuzzball03 Oct 27, 2016
93ca100
Update config.c
fuzzball03 Oct 27, 2016
02197a9
Create cgitelnet.h
fuzzball03 Oct 27, 2016
8919ff6
Update cgitelnet.h
fuzzball03 Oct 27, 2016
f315385
Create cgitelnet.c
fuzzball03 Oct 27, 2016
59edf88
Update serbridge.c
fuzzball03 Oct 27, 2016
6054496
Update serbridge.c
fuzzball03 Oct 27, 2016
a230f42
Update main.c
fuzzball03 Oct 27, 2016
4bddea7
Update main.c
fuzzball03 Oct 27, 2016
04bbccb
Update main.c
fuzzball03 Oct 27, 2016
936951d
Update main.c
fuzzball03 Oct 27, 2016
0009d8f
Update cgitelnet.c
fuzzball03 Oct 27, 2016
bead65f
Update cgitelnet.c
fuzzball03 Oct 27, 2016
c3a3b06
Update serbridge.c
fuzzball03 Oct 27, 2016
67a05de
Update cgitelnet.c
fuzzball03 Oct 27, 2016
1cf190a
Update cgitelnet.c
fuzzball03 Oct 27, 2016
6fb97bd
Update config.h
fuzzball03 Oct 27, 2016
a01db32
Update cgitelnet.c
fuzzball03 Oct 27, 2016
157569e
Cgitelnet changes/fixes
fuzzball03 Oct 28, 2016
fe95b4b
Cleanup
fuzzball03 Oct 28, 2016
ffd13c6
Ajax/Html changes
fuzzball03 Oct 28, 2016
3cb3804
Cgitelnet update
fuzzball03 Oct 28, 2016
a9f583e
Update cgitelnet.c
fuzzball03 Oct 28, 2016
7a93821
Update cgitelnet.c
fuzzball03 Oct 28, 2016
00d8b9f
Update cgitelnet.c
fuzzball03 Oct 28, 2016
973e4fb
Update .travis.yml
fuzzball03 Oct 28, 2016
b79a6d6
update for s3
fuzzball03 Oct 28, 2016
d887feb
Update .travis.yml
fuzzball03 Oct 28, 2016
e25d896
Update .travis.yml
fuzzball03 Oct 28, 2016
30658c5
Update .travis.yml
fuzzball03 Oct 28, 2016
8cd915f
Cgitelnet reform json output
fuzzball03 Oct 28, 2016
1da3ce7
Update cgitelnet.c
fuzzball03 Oct 28, 2016
6a730e7
Update cgitelnet.c
fuzzball03 Oct 28, 2016
7d60520
Update home.html
fuzzball03 Oct 28, 2016
338f983
Update readme to reflect changes
fuzzball03 Oct 31, 2016
3fdfe93
Various changes
fuzzball03 Oct 31, 2016
3f16121
Fix a few errors..
fuzzball03 Oct 31, 2016
2458e11
Serialbridge.c update
fuzzball03 Oct 31, 2016
27e6b5d
Fix compile errors
dannybackx Nov 1, 2016
36f15c9
Fix compile errors
dannybackx Nov 1, 2016
59a4707
Fix compile errors
dannybackx Nov 1, 2016
654f2ef
Fix compile errors
dannybackx Nov 1, 2016
4b3293e
Change comment
dannybackx Nov 1, 2016
547540d
Fix the build problem : don't call sprintf.
dannybackx Nov 1, 2016
589158e
Aha
dannybackx Nov 1, 2016
f3060e6
Change call to 0/1 instead of 1/2
dannybackx Nov 1, 2016
286e886
Makefile/Build file changes
fuzzball03 Nov 3, 2016
6596883
Formatting cleanup
fuzzball03 Nov 3, 2016
0b8368a
Modify all calls to port variables to match. Espconn1 = TelnetPort1
fuzzball03 Nov 3, 2016
b8404a1
Fix error for sucessful Travis build
fuzzball03 Nov 3, 2016
bda82de
Start making changes for Danny's security settings
fuzzball03 Nov 4, 2016
623f7b4
fix error
fuzzball03 Nov 4, 2016
5e346a3
Fix errors
fuzzball03 Nov 4, 2016
b5243b0
HTML Changes.
fuzzball03 Nov 4, 2016
6fd5938
Update .travis.yml
fuzzball03 Nov 16, 2016
25feca5
Update .travis.yml
fuzzball03 Nov 23, 2016
23a904f
5
fuzzball03 Nov 23, 2016
1df972b
9
fuzzball03 Nov 23, 2016
153f470
10
fuzzball03 Nov 23, 2016
9fcee90
12
fuzzball03 Nov 23, 2016
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
44 changes: 20 additions & 24 deletions .travis.yml
Original file line number Diff line number Diff line change
@@ -1,31 +1,27 @@
# Travis-CI file for Esp-Link

language: c

before_install:
- curl -Ls http://s3.voneicken.com/xtensa-lx106-elf-20160330.tgx | tar Jxf -
- curl -Ls http://s3.voneicken.com/esp_iot_sdk_v2.0.0.p1.tgx | tar -C .. -Jxf -

- curl -Ls http://s3.voneicken.com/xtensa-lx106-elf-20160330.tgx | tar Jxf -
- curl -Ls http://s3.voneicken.com/esp_iot_sdk_v2.0.0.p1.tgx | tar -C .. -Jxf -
after_script:
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why all these formatting changes here? please don't make random formatting changes, it makes reviewing difficult, plus, I don't see why your formatting is better than mine...

# upload to an S3 bucket, requires S3_BUCKET, AWS_ACCESS_KEY_ID and AWS_SECRET_KEY to be set
# in environment using travis' repository settings
- "if [[ -n \"$S3_BUCKET\" && -n \"$AWS_ACCESS_KEY_ID\" ]]; then
echo Uploading *.tgz to $S3_BUCKET;
curl -Ls https://github.com/rlmcpherson/s3gof3r/releases/download/v0.5.0/gof3r_0.5.0_linux_amd64.tar.gz | tar zxf - gof3r_0.5.0_linux_amd64/gof3r;
mv gof3r*/gof3r .;
ls *.tgz | xargs -I {} ./gof3r put -b $S3_BUCKET -k esp-link/{} --acl public-read -p {};
ls *.tgz | xargs -I {} echo \"URL: http://$S3_BUCKET/esp-link/{}\";
fi"

- 'if [[ -n "$S3_BUCKET" && -n "$AWS_ACCESS_KEY_ID" ]]; then echo Uploading *.tgz
to $S3_BUCKET; curl -Ls https://github.com/rlmcpherson/s3gof3r/releases/download/v0.5.0/gof3r_0.5.0_linux_amd64.tar.gz
| tar zxf - gof3r_0.5.0_linux_amd64/gof3r; mv gof3r*/gof3r .; ls *.tgz | xargs -I
{} ./gof3r put -b $S3_BUCKET -k esp-link/{} --acl public-read -p {}; ls *.tgz |
xargs -I {} echo "URL: http://$S3_BUCKET/esp-link/{}"; fi'
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what is this change about?

compiler: gcc

env:

env:
script:
- export XTENSA_TOOLS_ROOT=$PWD/xtensa-lx106-elf/bin/
- export BRANCH=$TRAVIS_BRANCH
#- export SDK_BASE=$PWD/esp_iot_sdk_v2.0.0.p1
- make release

- export XTENSA_TOOLS_ROOT=$PWD/xtensa-lx106-elf/bin/
- export BRANCH=$TRAVIS_BRANCH
- make release
notifications:
email: false
deploy:
skip_cleanup: true
provider: releases
api_key:
secure: unYyTCLpk1ixcNOyoUwroBqqx0yBhii56IXm57kjo5kl3umf1GRb3FUIE6la+B0njsNwAUNR/uLn6wF4FqYTUJzNQZskJDJfZjb53vwuoHaoa5j4K/bWB9zRlQ1XZBTkV48cxz8Ef2KyNduK2IciOHwsw3LQS0em3dpK7oG/20VzELt23Gx8uhBYa+OUzlr3Y+PYPynkwM30YwVQXpCy/GMgEbrcKheGbLTAIp7tms0KDAvbb98U0BI3tWBckE5GzAYYAmrXgyDXtEsU/poCMqUj/lpPl1s/5uxGVevTO7XuL4AYtF//AixsM20bPKtIZDHZS9b7JHtVhU655bY2aAfpMgf7xzkKbJkRzeAzT9HucFDjLY48yW4vztdJxBgkAL9d064gTHhThtn4hylZAYpHnqUiM0j4DKil5A0VG2F8EVEqZ7Q2tNzy6aqq37wzTuYXsYpz3mglpazaXXp/LoSurDHy1gz6aB/mdaeBoL3MX1q09LBE8lFGYBILQ8KUkrLyJathxAVvDBnl7nXFv2NWoZ2i7CfXdpCwmOVUN2WhudNfgbbaMung+voTFB+yLq9PBQP5gdP0MKU3zDTB/msmZo1pp/SbnNETCrKAdRtxNI+bxTQ98njAIkxI+7ZiVV8SMNEPyNcWq/6ViYDcIHJMR4Gq0DZunre1voEs1F4=
file_glob: true
file: esp-link-master-*.t*gz
on:
repo: fuzzball03/esp-link
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what is this change about?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ignore any Travis changes please.
I've done those changes so any commits made on my fork will compile via Travis without the need for me to build it myself.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

mhh, I'm not a fan of having to go and clean-up after you ;-) but I also see that the uploads aren't working for pull requests. I had thought that they would. I think the solution is for me to provide my S3 keys to anyone who wants to have the builds done automatically.

1 change: 0 additions & 1 deletion esp-link/cgipins.c
Original file line number Diff line number Diff line change
@@ -1,4 +1,3 @@

#include <esp8266.h>
#include "cgi.h"
#include "espfs.h"
Expand Down
85 changes: 85 additions & 0 deletions esp-link/cgitelnet.c
Original file line number Diff line number Diff line change
@@ -0,0 +1,85 @@
#include <esp8266.h>
#include "cgi.h"
#include "config.h"
#include "serbridge.h"

// Cgi to return choice of Telnet ports
int ICACHE_FLASH_ATTR cgiTelnetGet(HttpdConnData *connData) {
if (connData->conn==NULL) return HTTPD_CGI_DONE; // Connection aborted

char buff[1024];
int len;

os_printf("Current telnet ports: port1=%d port2=%d\n",
flashConfig.telnet_port1, flashConfig.telnet_port2);

len = os_sprintf(buff,
"{ \"port1\": \"%d\", \"port2\": \"%d\" }",
flashConfig.telnet_port1, flashConfig.telnet_port2);

jsonHeader(connData, 200);
httpdSend(connData, buff, len);
return HTTPD_CGI_DONE;
}

// Cgi to change choice of Telnet ports
int ICACHE_FLASH_ATTR cgiTelnetSet(HttpdConnData *connData) {
if (connData->conn==NULL) {
return HTTPD_CGI_DONE; // Connection aborted
}

char *coll;
int8_t ok = 0;
uint16_t port1, port2;
ok |= getUInt16Arg(connData, "port1", &port1);
ok |= getUInt16Arg(connData, "port2", &port2);
if (ok < 0) { coll = "Failed to fetch ports. Are they valid?"; goto collision; }
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This should perhaps be <= 0? As it is you're not returning any response when ok==0 and that's not good.
Second issue is that goto collision results in an rather poor error message.
Third issue is that having the string verbatim here ends up putting it into RAM, which is not plentiful. If you used sprintf the constant format string ends up in flash and doesn't consume RAM (there's some hacky magic that does that).

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That's certainly something I was unaware of. I will try a better approach based on your recommendations sir.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

no problem. I should go through the whole code and see where I can push constant strings into flash. Can never have too much memory on this thing...


if (ok > 0) {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I heaven't dealt with the ajax stuff in a while and forgotten everything (oops), but I think you're gonna get one port at a time when you fill out one input field and hit enter.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think you're right. Ill modify to have it check the flashconfig variables.

// fill both port variables from flash or ajax provided value
if (!port1) port1 = flashConfig.telnet_port1;
if (!port2) port2 = flashConfig.telnet_port2;

// check whether ports are different
if (port1 == port2) { coll = "Ports cannot be the same!"; goto collision; }

// we're good, set flashconfig
flashConfig.telnet_port1 = port1;
flashConfig.telnet_port2 = port2;
os_printf("Telnet ports changed: port1=%d port2=%d\n",
flashConfig.telnet_port1, flashConfig.telnet_port2);

// save to flash
if (configSave()) {
httpdStartResponse(connData, 204);
httpdEndHeaders(connData);
} else {
httpdStartResponse(connData, 500);
httpdEndHeaders(connData);
httpdSend(connData, "Failed to save config", -1);
}

// apply the changes
serbridgeInit(flashConfig.telnet_port1, flashConfig.telnet_port2);
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Something that is missing here is to call a new serbridgeStop function that closes the current listening sockets and resets any serbridge state so you can call serbridgeInit again. The latter wasn't designed to be called multiple times...
This may also explain some of the issues you have been seeing.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That makes sense.
I did wonder how it was handling another call like that.
randy in #205 made some changes to the serbridgeinit function - ill look and see if perhaps he addressed this already.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Citrection, #206 is the code I was referring to of Randys

}
return HTTPD_CGI_DONE;

collision: {
char buff[128];
os_sprintf(buff, "Ports assignment for %s collides with another assignment", coll);
errorResponse(connData, 400, buff);
return HTTPD_CGI_DONE;
}
}

int ICACHE_FLASH_ATTR cgiTelnet(HttpdConnData *connData) {
if (connData->conn==NULL) return HTTPD_CGI_DONE; // Connection aborted. Clean up.
if (connData->requestType == HTTPD_METHOD_GET) {
return cgiTelnetGet(connData);
} else if (connData->requestType == HTTPD_METHOD_POST) {
return cgiTelnetSet(connData);
} else {
jsonHeader(connData, 404);
return HTTPD_CGI_DONE;
}
}
8 changes: 8 additions & 0 deletions esp-link/cgitelnet.h
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
#ifndef CGITELNET_H
#define CGITELNET_H

#include "httpd.h"

int cgiTelnet(HttpdConnData *connData);

#endif // CGITELNET_H
2 changes: 2 additions & 0 deletions esp-link/config.c
Original file line number Diff line number Diff line change
Expand Up @@ -35,6 +35,8 @@ FlashConfig flashDefault = {
.data_bits = EIGHT_BITS,
.parity = NONE_BITS,
.stop_bits = ONE_STOP_BIT,
.telnet_port1 = 23,
.telnet_port2 = 2323,
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Something that seems to be missing is to take care of the upgrade path. When someone upgrades the telnet_portN fields in flash will be 0, so something needs to detect that when loading from flash and set the defaults explicitly.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ill take a look to see how that was done in some other code and proceed appropriately.

Copy link
Author

@fuzzball03 fuzzball03 Oct 31, 2016

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@tve So I looked into this a bit - as the code stands now, if I erase the flash... Then flash my current build, the default ports of 23 & 2323 are set(as they are set in this file). How is it accomplishing this?

As far as I can tell, the configRestore() function is where checks for "0" values are checked.
Why not simply use a loop to check all the flashConfig variables for "0" or NULL and fill them with their flashDefault values if true? (Just trying to learn here - I'm sure you or someone else has a good reason here)

};

typedef union {
Expand Down
4 changes: 3 additions & 1 deletion esp-link/config.h
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ typedef struct {
char hostname[32]; // if using DHCP
uint32_t staticip, netmask, gateway; // using DHCP if staticip==0
uint8_t log_mode; // UART log debug mode
uint8_t swap_uart; // swap uart0 to gpio 13&15
uint8_t swap_uart; // swap uart0 to gpio 13&15
uint8_t tcp_enable, rssi_enable; // TCP client settings
char api_key[48]; // RSSI submission API key (Grovestreams for now)
uint8_t slip_enable, mqtt_enable, // SLIP protocol, MQTT client
Expand Down Expand Up @@ -41,6 +41,8 @@ typedef struct {
int8_t data_bits;
int8_t parity;
int8_t stop_bits;
uint16_t telnet_port1, // Telnet port settings
telnet_port2;
} FlashConfig;
extern FlashConfig flashConfig;

Expand Down
4 changes: 3 additions & 1 deletion esp-link/main.c
Original file line number Diff line number Diff line change
Expand Up @@ -32,6 +32,7 @@
#include "gpio.h"
#include "cgiservices.h"
#include "web-server.h"
#include "cgitelnet.h"

#ifdef SYSLOG
#include "syslog.h"
Expand Down Expand Up @@ -96,6 +97,7 @@ HttpdBuiltInUrl builtInUrls[] = {
{ "/services/info", cgiServicesInfo, NULL },
{ "/services/update", cgiServicesSet, NULL },
{ "/pins", cgiPins, NULL },
{ "/telnet", cgiTelnet, NULL},
#ifdef MQTT
{ "/mqtt", cgiMqtt, NULL },
#endif
Expand Down Expand Up @@ -179,7 +181,7 @@ user_init(void) {
WEB_Init();

// init the wifi-serial transparent bridge (port 23)
serbridgeInit(23, 2323);
serbridgeInit(flashConfig.telnet_port1, flashConfig.telnet_port1);
uart_add_recv_cb(&serbridgeUartCb);
#ifdef SHOW_HEAP_USE
os_timer_disarm(&prHeapTimer);
Expand Down
26 changes: 26 additions & 0 deletions html/home.html
Original file line number Diff line number Diff line change
Expand Up @@ -50,6 +50,29 @@ <h1>Info</h1>
<a href="https://github.com/jeelabs/esp-link/blob/master/README.md">the online README</a>
for up-to-date help.</p>
</div>
<div class="card">
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks like the indent is off...

<h1>Telnet Serial-Bridge</h1>
<p style="margin-bottom:0;">There are two ports available for telnet to use by default: 23 &amp; 2323 <br>
Note - this time, only port1 may be changed &amp; used sucessfully.</p>
<div id="telnet-spinner" class="spinner spinner-small"></div>
<table id="telnet-table" class="pure-table pure-table-horizontal" hidden><tbody>
<tr><td>Current Telnet ports</td><td class="telnet-info"></td></tr>
<tr><td colspan=2 class="popup-target">Telnet port 1:<br>
<div class="click-to-edit telnet-port1">
<span class="edit-off" style="display:block; width:auto;"></span>
<input class="edit-on" maxlength=5 hidden> </input>
<div class="popup">Click to edit!<br>Default port: 23</div>
</div>
</td></tr>
<tr><td colspan=2 class="popup-target">Telnet port 2:<br>
<div class="click-to-edit telnet-port2">
<span class="edit-off" style="display:block; width:auto;"></span>
<input class="edit-on" maxlength=5 hidden> </input>
<div class="popup">Click to edit!<br>Default port: 2323</div>
</div>
</td></tr>
</tbody></table>
</div>
</div>
<!-- RIGHT COLUMN -->
<div class="pure-u-1 pure-u-md-1-2">
Expand Down Expand Up @@ -152,9 +175,12 @@ <h1>System details</h1>
onLoad(function() {
makeAjaxInput("system", "description");
makeAjaxInput("system", "name");
makeAjaxInput("telnet", "port1");
makeAjaxInput("telnet", "port2");
fetchPins();
getWifiInfo();
getSystemInfo();
getTelnetInfo();
bnd($("#pinform"), "submit", setPins);
});
</script>
Expand Down
18 changes: 18 additions & 0 deletions html/ui.js
Original file line number Diff line number Diff line change
Expand Up @@ -302,6 +302,22 @@ function getWifiInfo() {
function(s, st) { window.setTimeout(getWifiInfo, 1000); });
}

//===== Telnet info

function showTelnetInfo(data) {
Object.keys(data).forEach(function(v) {
setEditToClick("telnet-"+v, data[v]);
});
$("#telnet-spinner").setAttribute("hidden", "");
$("#telnet-table").removeAttribute("hidden");
currAp = data.ssid;
}

function getTelnetInfo() {
ajaxJson('GET', "/telnet", showTelnetInfo,
function(s, st) { window.setTimeout(getTelnetInfo, 1000); });
}

//===== System info

function showSystemInfo(data) {
Expand All @@ -323,6 +339,8 @@ function makeAjaxInput(klass, field) {
var eon = $(".edit-on", div);
var eoff = $(".edit-off", div)[0];
var url = "/"+klass+"/update?"+field;
//Dirty fix to avoid to seperate name spaces to GET or PUT telnet ports
if (klass == "telnet") { var url = "/"+klass+"?"+field; }

if (eoff === undefined || eon == undefined) return;

Expand Down