forward Redis requests across AWS regionsHow do you get Redis connections working within an Amazon VPC private subnet?AWS - how to serve faster to oversea usersAWS StrongSwan IPSec VPNAWS Site-to-Site VPN and Remote-Access VPN Server using PritunlService VPC for on premise connection in awsVPN connection between 2 AWS regionsVerizon VPN to AWS VPCConnect to Redis through Haproxy (or maybe stunnel) skipping TLSscrapy-redis can't connect to AWS Redis ElastiCacheBest practise for connecting physical site to aws region which is not local?
How do I professionally let my manager know I'll quit over smoking in the office?
NSE Numerical IQ Test no.12: 759802, 358829, 847123,?
Drawing people along with x and y axis
Why tighten down in a criss-cross pattern?
What is "industrial ethernet"?
Understanding the reasoning of the woman who agreed with King Solomon to "cut the baby in half"
What does it mean to "control target player"?
How to make clear to people I don't want to answer their "Where are you from?" question?
Can White Castle?
Why do textbooks often include the solutions to odd or even numbered problems but not both?
Loss of power when I remove item from the outlet
What's the difference between a deep fryer and a chip pan?
Is there a maximum distance from a planet that a moon can orbit?
Does this Wild Magic result affect the sorcerer or just other creatures?
How to get cool night-vision without lame drawbacks?
Can humans ever directly see a few photons at a time? Can a human see a single photon?
How much will studying magic in an academy cost?
How long would it take to cross the Channel in 1890's?
Should developer taking test phones home or put in office?
Are all instances of trolls turning to stone ultimately references back to Tolkien?
"How can you guarantee that you won't change/quit job after just couple of months?" How to respond?
Minimum distance between holes in inner tube
What is the legal status of travelling with methadone in your carry-on?
Should I prioritize my 401k over my student loans?
forward Redis requests across AWS regions
How do you get Redis connections working within an Amazon VPC private subnet?AWS - how to serve faster to oversea usersAWS StrongSwan IPSec VPNAWS Site-to-Site VPN and Remote-Access VPN Server using PritunlService VPC for on premise connection in awsVPN connection between 2 AWS regionsVerizon VPN to AWS VPCConnect to Redis through Haproxy (or maybe stunnel) skipping TLSscrapy-redis can't connect to AWS Redis ElastiCacheBest practise for connecting physical site to aws region which is not local?
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;
I have a Redis instance running on AWS Elasticache in US-East. I have VPN servers running in Tokyo and US-East.
The problem: How to allow Redis connections while VPNd to the Tokyo VPN? You can only open Elasticache security groups to the same region, so it doesn't work for the Tokyo VPN.
It seems like I should be able to make the Tokyo VPN tunnel all the Redis traffic through the US-East VPN but I just don't really know how to do that. Can anyone get me started in the right direction? Do I setup something with iptables or ssh port forwarding or what?
I only want to tunnel the Redis traffic (single TCP port). The rest of the traffic should be handled normally.
My Tokyo VPN is Ubuntu 12.04.4 LTS (L2TP VPN) and the US-East VPN is running some Ubuntu 12.04 AMI that comes pre-installed with OpenVPN.
I know the proper AWS way of working here is to duplicate my Redis instance and application servers in Tokyo, or to use VPC, but I would rather just stick with my existing infrastructure / architecture. I don't think converting to VPC is a non-trivial amount of work, and the only reason I'm using a VPN in Tokyo is so our single employee living in China has a fast VPN to the rest of our services running in US-East. The Great Firewall of China was causing problems for him when he was using our US-East VPN.
networking amazon-web-services redis
asked Apr 21 '14 at 11:59
tayl0rtayl0r
112
add a comment |
I have a Redis instance running on AWS Elasticache in US-East. I have VPN servers running in Tokyo and US-East.
The problem: How to allow Redis connections while VPNd to the Tokyo VPN? You can only open Elasticache security groups to the same region, so it doesn't work for the Tokyo VPN.
It seems like I should be able to make the Tokyo VPN tunnel all the Redis traffic through the US-East VPN but I just don't really know how to do that. Can anyone get me started in the right direction? Do I setup something with iptables or ssh port forwarding or what?
I only want to tunnel the Redis traffic (single TCP port). The rest of the traffic should be handled normally.
My Tokyo VPN is Ubuntu 12.04.4 LTS (L2TP VPN) and the US-East VPN is running some Ubuntu 12.04 AMI that comes pre-installed with OpenVPN.
I know the proper AWS way of working here is to duplicate my Redis instance and application servers in Tokyo, or to use VPC, but I would rather just stick with my existing infrastructure / architecture. I don't think converting to VPC is a non-trivial amount of work, and the only reason I'm using a VPN in Tokyo is so our single employee living in China has a fast VPN to the rest of our services running in US-East. The Great Firewall of China was causing problems for him when he was using our US-East VPN.
networking amazon-web-services redis
asked Apr 21 '14 at 11:59
tayl0rtayl0r
112
1
It should take less than an hour to set up VPC if you've never done it before.
– Michael Hampton♦
Apr 21 '14 at 13:22
Is it easy to convert an existing infrastructure to VPC though? I don't want to have to recreate all my instances or stop/restart them.
– tayl0r
Apr 21 '14 at 13:24
Just read some stuff about converting from EC2 to VPC. Definitely not something I want to do right now.
– tayl0r
Apr 21 '14 at 14:04
Given that Redis is a blocking, single threaded server, the network latency will murder performance.
– Brennen Smith
Jun 5 at 21:20
add a comment |
I have a Redis instance running on AWS Elasticache in US-East. I have VPN servers running in Tokyo and US-East.
The problem: How to allow Redis connections while VPNd to the Tokyo VPN? You can only open Elasticache security groups to the same region, so it doesn't work for the Tokyo VPN.
It seems like I should be able to make the Tokyo VPN tunnel all the Redis traffic through the US-East VPN but I just don't really know how to do that. Can anyone get me started in the right direction? Do I setup something with iptables or ssh port forwarding or what?
I only want to tunnel the Redis traffic (single TCP port). The rest of the traffic should be handled normally.
My Tokyo VPN is Ubuntu 12.04.4 LTS (L2TP VPN) and the US-East VPN is running some Ubuntu 12.04 AMI that comes pre-installed with OpenVPN.
I know the proper AWS way of working here is to duplicate my Redis instance and application servers in Tokyo, or to use VPC, but I would rather just stick with my existing infrastructure / architecture. I don't think converting to VPC is a non-trivial amount of work, and the only reason I'm using a VPN in Tokyo is so our single employee living in China has a fast VPN to the rest of our services running in US-East. The Great Firewall of China was causing problems for him when he was using our US-East VPN.
networking amazon-web-services redis
asked Apr 21 '14 at 11:59
tayl0rtayl0r
112
I have a Redis instance running on AWS Elasticache in US-East. I have VPN servers running in Tokyo and US-East.
The problem: How to allow Redis connections while VPNd to the Tokyo VPN? You can only open Elasticache security groups to the same region, so it doesn't work for the Tokyo VPN.
It seems like I should be able to make the Tokyo VPN tunnel all the Redis traffic through the US-East VPN but I just don't really know how to do that. Can anyone get me started in the right direction? Do I setup something with iptables or ssh port forwarding or what?
I only want to tunnel the Redis traffic (single TCP port). The rest of the traffic should be handled normally.
My Tokyo VPN is Ubuntu 12.04.4 LTS (L2TP VPN) and the US-East VPN is running some Ubuntu 12.04 AMI that comes pre-installed with OpenVPN.
I know the proper AWS way of working here is to duplicate my Redis instance and application servers in Tokyo, or to use VPC, but I would rather just stick with my existing infrastructure / architecture. I don't think converting to VPC is a non-trivial amount of work, and the only reason I'm using a VPN in Tokyo is so our single employee living in China has a fast VPN to the rest of our services running in US-East. The Great Firewall of China was causing problems for him when he was using our US-East VPN.
networking amazon-web-services redis
networking amazon-web-services redis
asked Apr 21 '14 at 11:59
tayl0rtayl0r
112
asked Apr 21 '14 at 11:59
tayl0rtayl0r
112
asked Apr 21 '14 at 11:59
tayl0rtayl0r
112
asked Apr 21 '14 at 11:59
tayl0rtayl0r
112
asked Apr 21 '14 at 11:59
tayl0rtayl0r
112
112
1
It should take less than an hour to set up VPC if you've never done it before.
– Michael Hampton♦
Apr 21 '14 at 13:22
Is it easy to convert an existing infrastructure to VPC though? I don't want to have to recreate all my instances or stop/restart them.
– tayl0r
Apr 21 '14 at 13:24
Just read some stuff about converting from EC2 to VPC. Definitely not something I want to do right now.
– tayl0r
Apr 21 '14 at 14:04
Given that Redis is a blocking, single threaded server, the network latency will murder performance.
– Brennen Smith
Jun 5 at 21:20
add a comment |
1
It should take less than an hour to set up VPC if you've never done it before.
– Michael Hampton♦
Apr 21 '14 at 13:22
Is it easy to convert an existing infrastructure to VPC though? I don't want to have to recreate all my instances or stop/restart them.
– tayl0r
Apr 21 '14 at 13:24
Just read some stuff about converting from EC2 to VPC. Definitely not something I want to do right now.
– tayl0r
Apr 21 '14 at 14:04
Given that Redis is a blocking, single threaded server, the network latency will murder performance.
– Brennen Smith
Jun 5 at 21:20
1
1
It should take less than an hour to set up VPC if you've never done it before.
– Michael Hampton♦
Apr 21 '14 at 13:22
It should take less than an hour to set up VPC if you've never done it before.
– Michael Hampton♦
Apr 21 '14 at 13:22
Is it easy to convert an existing infrastructure to VPC though? I don't want to have to recreate all my instances or stop/restart them.
– tayl0r
Apr 21 '14 at 13:24
Is it easy to convert an existing infrastructure to VPC though? I don't want to have to recreate all my instances or stop/restart them.
– tayl0r
Apr 21 '14 at 13:24
Just read some stuff about converting from EC2 to VPC. Definitely not something I want to do right now.
– tayl0r
Apr 21 '14 at 14:04
Just read some stuff about converting from EC2 to VPC. Definitely not something I want to do right now.
– tayl0r
Apr 21 '14 at 14:04
Given that Redis is a blocking, single threaded server, the network latency will murder performance.
– Brennen Smith
Jun 5 at 21:20
Given that Redis is a blocking, single threaded server, the network latency will murder performance.
– Brennen Smith
Jun 5 at 21:20
add a comment |
1 Answer
1
active
oldest
votes
I figured out I can actually just use SSH port forwarding for this, and then connect to localhost instead of the Redis address.
ssh -L 6379:redisinstance.cache.amazonaws.com:6379 taylor@us-east.vpn.amazonaws.com
So, Redis traffic goes through the us-east box via ssh, while the rest of the traffic goes through the Tokyo VPN.
edited May 31 '14 at 3:44
DaAwesomeP
1186
answered Apr 28 '14 at 11:22
tayl0rtayl0r
112
Exactly. Two tips: add compression to your SSH connection (-C or Compression yes in .ssh/config) and use autossh. We'll add a howto on how to do this at userify.com shortly.
– Jamieson Becker
Feb 7 '17 at 17:03
add a comment |
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "2"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f590309%2fforward-redis-requests-across-aws-regions%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
I figured out I can actually just use SSH port forwarding for this, and then connect to localhost instead of the Redis address.
ssh -L 6379:redisinstance.cache.amazonaws.com:6379 taylor@us-east.vpn.amazonaws.com
So, Redis traffic goes through the us-east box via ssh, while the rest of the traffic goes through the Tokyo VPN.
edited May 31 '14 at 3:44
DaAwesomeP
1186
answered Apr 28 '14 at 11:22
tayl0rtayl0r
112
Exactly. Two tips: add compression to your SSH connection (-C or Compression yes in .ssh/config) and use autossh. We'll add a howto on how to do this at userify.com shortly.
– Jamieson Becker
Feb 7 '17 at 17:03
add a comment |
I figured out I can actually just use SSH port forwarding for this, and then connect to localhost instead of the Redis address.
ssh -L 6379:redisinstance.cache.amazonaws.com:6379 taylor@us-east.vpn.amazonaws.com
So, Redis traffic goes through the us-east box via ssh, while the rest of the traffic goes through the Tokyo VPN.
edited May 31 '14 at 3:44
DaAwesomeP
1186
answered Apr 28 '14 at 11:22
tayl0rtayl0r
112
Exactly. Two tips: add compression to your SSH connection (-C or Compression yes in .ssh/config) and use autossh. We'll add a howto on how to do this at userify.com shortly.
– Jamieson Becker
Feb 7 '17 at 17:03
add a comment |
I figured out I can actually just use SSH port forwarding for this, and then connect to localhost instead of the Redis address.
ssh -L 6379:redisinstance.cache.amazonaws.com:6379 taylor@us-east.vpn.amazonaws.com
So, Redis traffic goes through the us-east box via ssh, while the rest of the traffic goes through the Tokyo VPN.
edited May 31 '14 at 3:44
DaAwesomeP
1186
answered Apr 28 '14 at 11:22
tayl0rtayl0r
112
I figured out I can actually just use SSH port forwarding for this, and then connect to localhost instead of the Redis address.
ssh -L 6379:redisinstance.cache.amazonaws.com:6379 taylor@us-east.vpn.amazonaws.com
So, Redis traffic goes through the us-east box via ssh, while the rest of the traffic goes through the Tokyo VPN.
edited May 31 '14 at 3:44
DaAwesomeP
1186
answered Apr 28 '14 at 11:22
tayl0rtayl0r
112
edited May 31 '14 at 3:44
DaAwesomeP
1186
edited May 31 '14 at 3:44
DaAwesomeP
1186
edited May 31 '14 at 3:44
DaAwesomeP
1186
1186
answered Apr 28 '14 at 11:22
tayl0rtayl0r
112
answered Apr 28 '14 at 11:22
tayl0rtayl0r
112
answered Apr 28 '14 at 11:22
tayl0rtayl0r
112
112
Exactly. Two tips: add compression to your SSH connection (-C or Compression yes in .ssh/config) and use autossh. We'll add a howto on how to do this at userify.com shortly.
– Jamieson Becker
Feb 7 '17 at 17:03
add a comment |
Exactly. Two tips: add compression to your SSH connection (-C or Compression yes in .ssh/config) and use autossh. We'll add a howto on how to do this at userify.com shortly.
– Jamieson Becker
Feb 7 '17 at 17:03
Exactly. Two tips: add compression to your SSH connection (-C or Compression yes in .ssh/config) and use autossh. We'll add a howto on how to do this at userify.com shortly.
– Jamieson Becker
Feb 7 '17 at 17:03
Exactly. Two tips: add compression to your SSH connection (-C or Compression yes in .ssh/config) and use autossh. We'll add a howto on how to do this at userify.com shortly.
– Jamieson Becker
Feb 7 '17 at 17:03
add a comment |
Thanks for contributing an answer to Server Fault!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f590309%2fforward-redis-requests-across-aws-regions%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
1
It should take less than an hour to set up VPC if you've never done it before.
– Michael Hampton♦
Apr 21 '14 at 13:22
Is it easy to convert an existing infrastructure to VPC though? I don't want to have to recreate all my instances or stop/restart them.
– tayl0r
Apr 21 '14 at 13:24
Just read some stuff about converting from EC2 to VPC. Definitely not something I want to do right now.
– tayl0r
Apr 21 '14 at 14:04
Given that Redis is a blocking, single threaded server, the network latency will murder performance.
– Brennen Smith
Jun 5 at 21:20