Sidharth Sagar (Backend-Sr. Associate Consultant L2 - Development)

Apache Kafka is a type of technology that is used to publish and subscribe the messages based on the fault-tolerant messaging system. Kafka was originally developed by LinkedIn and after some time it open-sourced as a project under the Apache Software Foundation. It is used by many companies to build fault-tolerant, scalable data pipelines for streaming data. Kafka is specially designed to handle big amounts of data in real-time and that's why it is used for data-intensive applications. It is simply a publisher-subscriber model where producers publish the data on a topic and consumers subscribe to the topic to consume the data.

Advantages of Apache Kafka

1. Easily accessible: one of the advantages of using Kafka is that all our data gets stored in Kafka, very easily accessible to anyone.

2. Real-Time Handling: It is able to handle real-time data pipelines. Apache Kafka builds a real-time data pipeline that includes storage, processors, analytics, etc.

3. Low Latency: It offers a low latency value of up to 10 milliseconds. The reason behind this is that it decouples the message which lets the consumer consume the message at any time.

4. High Throughput: Because of low latency, it handles many messages of high velocity and volume. 
It can support thousands of messages within a second. That's why most companies use Kafka to load a high volume of data.

5. Fault tolerance: It has an essential feature to provide resistance to node or machine failure within the cluster.

6. Reduces the need for multiple integrations: One of the advantages of using Kafka is that the data written by the producer easily go through Kafka we only need to make one integration with Kafka and it automatically integrates us with every consuming and producing system.

Disadvantages of Apache Kafka

1. Do not have a complete set of monitoring tools: The new enterprises and startups are fear to work with the technology named Kafka. Because it doesn't contain a complete set of managing tools.

2. Message tweaking issues: For delivering the messages to the consumer Kafka broker uses system calls. So if the message needs tweaking the performance of this technology gets reduced. So we can say it does not work properly if the message needs to be changed.

3. wildcard topic selection not supported by Kafka: This technology does not support wildcard topic selection. Instead of this, it matches only the correct topic name. The reason behind this is that selecting wildcard topics makes it incapable to address certain use cases.

4. Clumsy Behaviour: If the number of queues increases in the Kafka cluster then it behaves clumsy.

5. Some message paradigms missing: Some message paradigms are missing in Kafka such as point-to-point queues, request or reply, etc.
 
6. Reduces Performance: By compressing-decompressing the data flow, brokers and consumers reduced the performance of Kafka.

We, at Oodles ERP, provide end-to-end enterprise web development services to help enterprises steer clear of their operational complexities. Contact us at [email protected] to learn more about our custom ERP development services. 

Stream In Java 8

Java 8 provides a new package which is called java.util.stream. Basically, it is used to process collections of objects. It consists of various types of classes, enums, and interfaces to perform operations on different elements. It is like a sequence of objects which supports different types of methods that are pipelined together to produce results. A stream can be used by importing the package java.util.stream.

Features of Java Stream
Below are the features of java stream:
- It does not store any element. It simply takes elements from a source like I/0 channel, data structure, or array, using a pipeline of 
  different types of operations.

- It is lazily executed any operation and performs any evaluation on code when required.

- In nature, the stream is functional and any operation performed on it does not change its source.

Types of Stream
Basically, there are two types of stream
1. Stream
2. Parallel Stream

Operations On Stream
Below are the operations which we can perform on a stream:

Intermediate Operations:

1). map: It is used to map stream elements to their corresponding result.

example:- List<String> languages = Arrays.asList("java", "angular", "nodejs", "python");
                  List<String> data = languages.stream().map(String::toUpperCase).collect(Collectors.toList());
                 System.out.println(data);

output:-  [JAVA, ANGULAR, NODEJS, PYTHON]
           

2). filter: It is used to test elements for a condition and generate a filtered result.

example :- List<Integer> numberList = Arrays.asList(45, 4, 6, 12, 20);
           List<Integer> numbers = numberList.stream()
                                        .filter(number -> number % 5 == 0)
                                        .collect(Collectors.toList());
           System.out.println(numbers);  

output:-  [45,20]

3). sorted: It is used to sort stream elements.

example :- List<Integer> numberList = Arrays.asList(-19, -29, 0, 5, 4);
                  List<Integer> numbers = numberList.stream().sorted().collect(Collectors.toList());
                  System.out.println(numbers);  
           
output:-  [-29, -19, 0, 4, 5]           

Terminal Operations:

1). forEach: It can be used to perform an iteration over the stream. Generally, it is used in place of the iterator.

example:- List<String> list = Arrays.asList("java", "python", "nodejs", "angular");
                  list.stream().forEach(System.out::println);

output:-  Java
               Python
               Nodejs 
               Angular         

2). collect: It is used to return the desired result of the operations performed on the stream.

example :-  List<Integer> number = Arrays.asList(8,3,6,5,3);
                   Set<Integer> square = number.stream().map(x->x*x).collect(Collectors.toSet());
                   System.out.println(square);
            
output :-   [64,9,36,25]            

3). reduce: It is used to perform reduction on elements of the stream.
           //for getting the product of all the elements in the given range excluding the rightmost element
example :- int result = IntStream.range(2, 7)
                           .reduce((num1, num2) -> num1 * num2)
                           .orElse(-1);

                 System.out.println(result);                           
          
output:-  720                  

We, at Oodles ERP, provide custom ERP application development services to solve complex business problems of our clients and customers. Our team uses the latest tech stack and agile methodologies to build custom enterprise solutions from the ground-up. Contact us at [email protected] to learn more about our enterprise web app development services. 

Operators In Python

In Python, operators are the special symbols that are responsible for the operation between two operands. We can also say that it is like a pillar of any program on which the logic is built in any programming language.

OPERATORS- Operators are special symbols like '-', '+' , '*' , '/', '=' etc.
OPERAND- Operand is a value on which the operator is applied.

The following are the operators available in python:

1). Arithmetic Operators
    These operators are used to perform mathematical operations between two operands. This type of operator is used with numeric values 
    to perform mathematical operations. In Python version 3.x, the division result is a floating-point number while in Python version 
    2.x, the division result of 2 integers was also an integer and if you want to obtain a result in integer type in Python version 3.x 
    floored (// integer) is used. The following are the arithmetic operators:
    
    a). Addition Operator (+): This operator is used to add two operands.
        Syntax: X + Y
        Example: a=5;
                         b=7;
                         print(a+b);
        Output: 12
        
    b). Subtraction Operator (-): This operator is used to subtract one operand from another.
        Syntax: X - Y
        Example: a=7;
                        b=5;
                        print(a-b);
        Output: 2   
        
    c). Multiplication Operator (*): This operator is used to multiply one operand with the other operand.    
        Syntax: X * Y
        Example: a=7;
                         b=5;
                         print(a*b);
        Output: 35
          
    d). Division Operator (/): This operator is used to divide the first operand by the second operand. 
        Syntax: X / Y
        Example: a=7;
                         b=5;
                         print(a/b);
        Output: 1.4
        
    e). Reminder Operator (%): This operator returns the remainder when dividing the first operand by the second operand.    
        Syntax: X % Y
        Example: a=7;
                        b=5;
                        print(a%b);
        Output: 2
        
    f). Exponent Operator (**): This operator calculates the first operand power to the second operand.
        Syntax: X ** Y
        Example: a=3;
                        b=2;
                        print(3**2);
        Output: 2    
    
    g). Floor Division Operator (//): This operator gives the floor value of the quotient generated by dividing the two operands.
        Syntax: X // Y
        Example: a=7;
                        b=5;
                        print(a//b);
        Output: 1

2). Comparison Operators
    These operators are used to compare the first operand value to the second operand value. It returns a boolean value such as true or 
    false. It is also known as Relational operators. Following are the Comparison operators:
    
    a). Equal Operator (==): This operator returns true if the values of two operands are equal otherwise it returns false.
        Syntax: X == Y
        Example: a=7;
                        b=5;
                        print(a==b);
        Output: False
        
    b). Not Equal Operator (!=): This operator returns true if the values of two operands are not equal otherwise it returns false.    
        Syntax: X != Y
        Example: a=7;
                        b=5;
                        print(a!=b);
        Output: True
        
    c). Less Than Operator (<): This operator returns true if the values of the first operand are less than the second 
                                                    the operand, otherwise it returns false.
        Syntax: X < Y
        Example: a=7;
                        b=5;
                        print(a<b);
        Output: false
   
    d). Greater Than Operator (>): This operator returns true if the values of the first operand are greater than the second 
                                                          the operand, otherwise it returns false.         
        Syntax: X > Y
        Example: a=7;
                        b=5;
                        print(a>b);
        Output: True
        
    e). Less Than or Equal to Operator (<=): This operator returns true if the values of the first operand are less than or equal to the 
                                                                           the second operand, otherwise it returns false.
        Syntax: X <= Y
        Example: a=7;
                        b=5;
                        print(a<=b);
        Output: false      
        
    f). Greater Than or Equal to Operator (>=): This operator returns true if the values of the first operand are greater than or equal to 
                                                                                the second operand, otherwise it returns false.         
        Syntax: X >= Y
        Example: a=7;
                        b=5;
                        print(a>=b);
        Output: True          

3). Assignment Operators
    This type of operator is used to assign values to the variables. The following are the Assignment operators:

    a). Equal To Operator (=): This operator assigns the value of the right side of the expression to the left side operand.
        Syntax: X = Y + Z
        Example: a=7;
                        b=5;
                        c= a+b;
                        print(c);
        Output: 12 
    
    b). Add AND (+=): This operator adds the right operand to the left operand and assigns the result to the left operand.
        Syntax: X = X + Y or X+=Y
        Example: a=7;
                        b=5;
                        a= a+b;
                        print(a);
        Output: 12

    c). Subtract AND (-=): This operator subtracts the right operand from the left operand and assigns the result to the left operand.
        Syntax: X = X - Y or X-=Y
        Example: a=7;
                         b=5;
                         a= a-b;
                         print(a);
        Output: 2
        
    d). Multiply AND (*=): This operator multiplies the right operand with the left operand and assigns the result to the left operand.    
        Syntax: X = X * Y or X*=Y
        Example: a=7;
                        b=5;
                        a= a*b;
                        print(a);
        Output: 35
        
    e). Divide AND (/=): This operator divides the left operand with the right operand and assigns the result to the left operand.    
        Syntax: X = X / Y or X/=Y
        Example: a=7;
                         b=5;
                         a= a/b;
                         print(a);
        Output: 1.4
        
    f). Modulus AND (%=): This operator divides the left operand by the right operand and assigns the remainder back to the left operand.    
        Syntax: X = X % Y or X%=Y
        Example: a=7;
                        b=5;
                        a= a%b;
                        print(a);
        Output: 2
        
    g). Exponent AND (**=): This operator calculates the exponent value using operands and assigns the value to the left operand.    
        Syntax: X = X ** Y or X**=Y
        Example: a=3;
                 b=2;
                 a= a**b;
                 print(a);
        Output: 9
        
    h). Floor Division AND (//=): This operator divides the left operand by the right operand and then assigns the floor value to left 
                                                     operand.    
        Syntax: X = X // Y or X//=Y
        Example: a=7;
                        b=5;
                        a= a//b;
                        print(a);
        Output: 1
        
 

4). Bitwise Operators    
    This type of operator is generally used to work on bits and performs bit-by-bit operations on the values of the two operands. 
    These operators are commonly used to operate on binary numbers. Following are the Bitwise operators:

    
    a). Binary AND (&): If the bits of the left operand and right operand at the same place are 1, then 1 is copied to the result. Otherwise, 
                                       0 is copied.
        Syntax: X & Y
        Example: a=10;
                        b=4;
                         print(a&b);
        Output: 0

        
    b). Binary OR (|): If both the bits are zero then the resulting bit will be 0 otherwise, the resulting bit will be 1.    
        Syntax: X | Y
        Example: a=10;
                         b=4;
                         print(a|b);
        Output: 14

    
    c). Binary Ones Complement (~): This operator calculates the negation of each bit of the operand means if the bit is 0 then the 
                                                             the resulting bit is 1 or vice versa.
        Syntax: ~X
        Example: a=10;
                         print(~a);
        Output: -11

        
    d). Binary XOR (^): If both the bits are different then the resulting bit will be 1 otherwise, the resulting bit will be 0.    
        Syntax: X ^ Y
        Example: a=10;
                         b=4;
                         print(a^b);
        Output: 14

        
    e). Binary Left Shift (<<): The left operand value is moved left by the number of bits specified by the right operand.    
        Syntax: X << Y
        Example: a=10;
                         b=2;
                         print(a<<b);
        Output: 40

        
    f). Binary Right Shift (>>): The right operand value is moved right by the number of bits specified by the right operand.    
        Syntax: X >> Y
        Example: a=10;
                         b=2;
                         print(a>>b);
        Output: 2

        
5). Logical Operators
    These types of operators are used to combine conditional statements. The following are the Logical operators:
    
    a). Logical AND (and): If both the operands are true, then the condition will be true otherwise false.
        Syntax: X < 2 and  X < 4
        Example: a=1;
                        print(a<2 and a<4);
        Output: true

        
    b). Logical OR (or):   If any of the two operands are true, then the condition will be true otherwise false.
        Syntax: X > 2 or  X > 4
        Example: a=3;
                        print(a>2 or a>4);
        Output: true

        
    c). Logical NOT (not): This operator reverses the result, and returns true if the result is false.
        Syntax: not(X < 2 and X < 4)
        Example: a=1;
                        print(not(a<2 and a<4));
        Output: false
        
   

At Oodles ERP, we provide full-scale Enterprise app development services to solve complex business problems and strengthen your brand's online presence. Our development team specializes in using Python along with web frameworks like Django and Flask to build custom web applications that are easy to scale. Contact us at [email protected] to learn more about our enterprise web app development services.