Some notes on Anaconda python package manager: Reference: https://medium.freecodecamp.org/why-you-need-python-environments-and-how-to-manage-them-with-conda-85f155f4353c Conda is the main installer for the Anaconda packagesConda can be used to create multiple environments with different python or other package versions.The Anaconda packages are installed under /<some path>/Anaconda3/pkgs and other sub-directoriesInside a new Conda installation, the root environment is activated by default, so you … Continue reading Anaconda Python notes
Following are some concepts used in TLS/SSL configurations: Private Key: The key that is not shared with other connections but just used to decrypt the payload encrypted with public certificate.Public Certificate: The certificate that is provided to the remote connection as part of the SSL/TLS negotiations used to encrypt the message.CSR: certificate signing request is … Continue reading TLS and SSL notes
Following is a good article which worked successfully to connect Centos7 to Active Directory for users in AD to be able to login to Centos. Manually Connecting an SSSD Client to an Active Directory Domain https://access.redhat.com/articles/3023951 Another useful testing procedures blog: QA:Testcase Active Directory Setup https://fedoraproject.org/wiki/QA:Testcase_Active_Directory_Setup Realmd and SSSD Active Directory Authentication https://outsideit.net/realmd-sssd-ad-authentication/ … Continue reading Manually Connecting an SSSD Client to an Active Directory Domain
Some Wireshark filter fields match against multiple protocol fields. For example, "ip.addr" matches against both the IP source and destination addresses in the IP header. The same is true for "tcp.port", "udp.port", "eth.addr", and others. It's important to note that ip.addr == 10.43.54.65 is equivalent to ip.src == 10.43.54.65 or ip.dst == 10.43.54.65 This can be counterintuitive in some cases. … Continue reading Wireshark commands
Common Kerberos commands: 1.Change password of a principal(user) $ kadmin.local kadmin.local: cpw <principalname> Enter password for princal "principalname@REALM.COM": 2.initialize a kerberos ticket $ kinit <principalname> To get detailed verbose info use below options: $ KRB5_TRACE=/dev/stdout kinit -V 3. Destroy the current ticket: $ kdestroy 4. Check the status of Kerberos KDC $ systemctl status kadmin $ systemctl … Continue reading Kerberos commands
Following steps are needed to run a Java program in Hadoop with Kerberos security enabled: 1. Create a text file named FileCount.java and store it in your home directory such as /home/userid 2. Copy paste the below code into the file FileCount.java . Change the hadoop hostname from quickstart.cloudera:8020 to the correct host. import java.io.*; import … Continue reading Run a Java program in Hadoop with Kerberos enabled.
SPNEGO, and WebHDFS on Hadoop using Chrome browser: Reference: http://www.ghostar.org/2015/06/google-chrome-spnego-and-webhdfs-on-hadoop/ We want to see if the Chrome browser can be used to authenticate users with Kerberos and display Hadoop webhdfs REST api data. In the Cloudera Security .pdf manual follow these steps: Step 9: (Optional) Enable Authentication for HTTP Web Consoles for Hadoop Roles … Continue reading Kerberos, SPNEGO and WebHDFS on Hadoop using Chrome browser:
If you have a Centos server and want to install Chrome browser which will display GUI on Windows laptop using X server then follow these steps: First download and install Mobax terminal software on your laptop from https://mobaxterm.mobatek.net/ . This will provide the X server needed to display the browser on windows. Enable Google YUM … Continue reading Install Google Chrome on Centos 7
Reference: http://blog.cloudera.com/blog/2015/03/how-to-quickly-configure-kerberos-for-your-apache-hadoop-cluster/ Cloudera Security manual .pdf – CDH 5.15 on Cloudera Documentation website http://www.ghostar.org/2015/06/google-chrome-spnego-and-webhdfs-on-hadoop/ https://www.youtube.com/watch?v=4TwU0LwDJAg Environment: Cloudera CDH 5.15 on Centos 7 MIT KDC Kerberos Setting up Kerberos in Cloudera CDH is somewhat tricky. The above blog is a good step by step way to setup. Also refer to the official Cloudera Security … Continue reading Kerberos setup in Cloudera Hadoop
Virtualbox network setup for internet access: Generally the following table gives the connectivity for different Virtualbox Network adapters. Sometimes it is possible the Bridged network wont get an ipv4 address and cannot connect to internet. Then we have to setup both a NAT and a Host-only adapter network. The requirement is: Host is Windows 10, … Continue reading Virtualbox VM setups.