Tuesday, 6 February 2018

How to make API gateway listen to Microservice deployed on ECS under ALB

Now that the ECS and Docekerisation is something every AWS enthsuiast will be familiar with.There are still some challenges that are left to solve till AWS comes up with new features.

Problem:--  Enable API gateway URL endpoints for Microservices that are deployed on ECS in a private subnet  and are accessible through the ALB.

Constraint  API gateway can talk to Load balancer through VPC links but only when we have NLB.
No-brainer that we cant have a replicate deployment of API's under NLB to be accessible through API Gateway. ( unnecessary additional costs)

Solution

  1. Capture the instances and the dynamic port allocated to them by ALB under the desired Microservice target group.
  2. Create a target group specifically to be registered under NLB on the desired traffic port and add the captured instnaces and their port in the target registration tab.
  3. Create a NLB and make it listen to the created target group of step 2.
  4. Go to API gateway and create a VPC link with the NLB, it will take 3-4 minutes to become active.

You are set to use the VPC link for API Gateway deployment.

**Note**
For secuity reasons will advise the use of API key.

Cheers!!

Wednesday, 28 September 2016

AWS Database migraton service..it gets more fantastic with AWS

AWS Database Migration Service is a web service you can use for migrating data from database. Various scenarios that DMS supports :--
Database that is on-premises, to an Amazon Relational Database Service (Amazon RDS) DB instance
 Database that is on-premises, to a database on an Amazon Elastic Compute Cloud (Amazon EC2)
Migrate a database from an AWS service to an on-premises database.
Supported DB types and versions
Oracle versions 10g, 11g, 12c, for the Enterprise, Standard, Standard One, and Standard Two edition
Microsoft SQL Server versions 2005, 2008, 2008R2, 2012, 2014, and 2016 for the Enterprise, Standard, Workgroup, and Developer editions.
MySQL versions 5.5, 5.6, and 5.7
PostgreSQL versions 9.3 and later
Types of DB migrations
Homogenous
The DB migrations between the same engine type versions.
Heterogeneous
The DB migrations between the different engine type versions.
                      DMS Components










AWS DMS uses a replication server that connects to the source database, reads the source data, formats the data for consumption by the target database, and loads the data into the target database
At Source DB endpoint DMS collates the data and collects necessary information to convert them in a meaningful way.

At Target DB endpoint DMS migrate all objects to the specified database and schema or create each database and schema for you as it finds the schema on the source

Typically DMS can have 3 types of tasks

Migrate existing data (Full Load)
Take a outage and migrate the complete data from source to target.

Migrate existing data and replicate ongoing changes
This option performs a full data load while capturing changes on the source. Once the
full load is complete, captured changes are applied to the target

Replicate data changes only
In some situations AWS DMS can be used only to replicate changes starting when you
start your bulk load( using any other tool) and keep your source and target databases in
sync


!!Keep experimenting!!

Friday, 22 July 2016

AWS Storage Service called EBS

Hi People!!

Will get more and more information on various AWS services. 

Lets start with Storage, and will cover EBS.
uEBS provides block level storage  for use with Amazon EC2 instances.
uEBS volumes are highly available,reliable and scalable.
uOne can create EBS volumes within range of 1GB to 16 TB.
uEBS volumes behave like raw, unformatted block devices.You can create a file system on top of these
uYou can create point-in-time snapshots of EBS volumes providing long term durability.
uEBS volumes can be used primary storage for data that requires frequent updates, such as the system drive for an instance or storage for a database application.
uEBS volumes support encryption.

!!Cheers!!

Sunday, 1 May 2016

!! AWS !! ...the next big thing

Hi folks,

Thanks you so much for visiting my blog and liking my posts.

I was thinking of writing about AWS for long time but didn't find much time , but enough of wait and excuses it's high time to equip you all with insight on AWS.

AWS (Amazon Web Services) is the leader Cloud service provider and by all means the next big revolution of IT world.

Over the past decade they have established themselves as a partner to the Fortune 500 and when they won the $600MM government contract to build out a datacenter for the CIA they established themselves as a highly trusted partner.
If the CIA trusts them to host their infrastructure, then why wouldn't anyone of the Fortune 500 which are the latest adopters
AWS allows you to do great things as a Solution architect, any requirement of client can be implemented in 5 or more different ways using AWS services thereby giving the clients a leverage to have tailormade solutions created which are scalable,redundant,durable and very cost effective.
Now, I can keep on writing about AWS and glorify it, but I want you all to start tinkering your minds with the word "AWS" and let me know all your queries.
 I recently got AWS certified and I must say the journey with AWS has only begun and its really exciting process of getting certified which definitely gives you the edge and opens you up to AWS world.
Let your queries regarding training and certification flow on aws.trainer@outlook.com
!!Keep Experimenting!!
Cheers


Wednesday, 16 December 2015

P2V(Physical to Virtual) movement with OracleASM

P2V (Physical to virtual) movement means, moving your current environments from physical stacks to Virtual stacks.

I had this task of moving the database server with ASM installed to move to virtual server created using VMware. Tasks involved are:--

1.) Creation of Virtual instance by taking the snapshot of the Physical machine w/o raw disk.
     All the raw disks for ASM mounted in Physical server will become invalid when moving to Virtual                  environment.
2.) Once the Virtual environment is created cross check all mount points and files system.
3.) Create a fresh ASM instance and start cluster services, remember the hostname assigned to Virtual               server have to be same as of Physical server.
4.) Assign new raw disks to Virtual server and slice them for ASM as per your discretion
5.) Take either cold backup by taking a downtime or RMAN backup of all the databases to be moved on a       shared mount point.
6.) Post backup map shared backup mount point to virtual server.
7.) Mapping of common backup mount point to virtual server.
8.) Creating individual Disk Groups in ASM and add multiple disks to each Disk Group.
9.) Restoration of backups on virtual server.

Just switch over the existing IP of Physical server to Virtual server and perform the sanity check after that.


!!Keep Experimenting!!


Friday, 24 July 2015

Weblogic warning Closing socket as no data read from it on 10.1.1.1,100

In the webserver logs every administrator of PeopleSoft must have seen this warning message.

Closing socket as no data read from it on 14.96.62.76:60,197 during the configured idle

This message is nothing to be worried about but do fills up the log files , to avoid this warning message entry in logfiles carry on the following steps

1.Set the parameter -Dweblogic.client.socket.ConnectTimeout=XXXX,measured in milliseconds under JAVA_OPTIONS

 Example:
 -Dweblogic.client.socket.ConnectTimeout=300

Second way of doing this change.

2. Change duration time to a higher value in the below Console path
 Server -> Protocols (tab) -> HTTP (sub-tab) -> Duration






Monday, 29 June 2015

Oracle SES silent installation on Linux using responsefile



Starting with Oracle SES installation and configuration make sure that the certified OS is checked.

SES is not certified on Linux 6

Oracle SES Linux Certifications

Oracle SES is certified to run only on the following Linux operating systems:
  • Oracle Enterprise Linux 4 (Update 6 or higher to support WebLogic)
  • Oracle Enterprise Linux 5
  • Red Hat Enterprise Linux 4 AS and ES (Update 3 or higher)
  • Red Hat Enterprise Linux 5 AS and ES (or later updates)
  • SUSE Linux Enterprise Server 10
  • SUSE Linux Enterprise Server 11

I will explain how to install  SES using a responsefile but you all have the option of running it in easy and friendly GUI mode by setting up the DISPLAY variable.
Oracle provides the SES dump on edelivery in two parts ,which need to be downloaded and unzipped.
SES creates its own database and has separate weblogic server to administer it.

Lets begin the SES installation and Configuration:--

>> Installation has to be done with a non-root user.
>> open the response file make the following changes.
response file includes two parts. You only need to provide values in the first part. Values in the second part have already been set. You should never change them.

ORACLE_HOME_NAME=sesdev --> This is unique and limited to just 8 characters.
ORACLE_BASE=/psoft/oracle --> your oracle software location
ORACLE_HOME=/psoft/oracle/seshome --> this is your ses home location where SES specific files are installed                                                        
SEARCH_DATA_STORAGE_LOCATION=/psoft/oracle/oradata -->directory for datafiles,control files,redo logs.                                                                                                                       
SEARCH_ADMIN_PASSWORD=xxxxxxxx--> this is search serve administrative password and has to be of atleast 8 characters with 1 numerical must.                                                                                
SEARCH_HTTP_PORT=7777 --> this is http port of search server, that will be configured in later stage,  not to mention ports less then 1024 will need root privileges to start the server so avoid that, and also avoid 1521 port
                                                         
COMPONENT_LANGUAGES=("en") --> choose the various languages from the options given.

The chraracter set is by default AL32UTF8 which is mentioned in part 2 of the response file.

>> i specifically skipped the prerequsite check done by oracle by running this:--

./runInstaller -ignoreSysPrereqs -silent -responseFile /psoft/dumps/ses_11_1_2_2_0_linux64/response/server.rsp

and the installation kicked off going into success






Rest of the configuration in abundance in other blogs, Let me know if any of you run into issues .

Keep Experimenting
Cheers!!